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ABSTRACT 



College and University Environments Scales (CU^s) , 
an instrument tor characterizing the perceived atmosDhere o f 
institutions of higher education, was published by the Educational 
Testing Service in 1 q 6R. CUES is probably the most widely used 
instrument for describing college environments. The purposes of this 
study were to: (1) provide more adeguate national norms--document ing 

the range of institutional diversity on each of the it^ms and scales 
in CUES and the varieties and major types of profiles; (2) undertake 
a thorough reanalysis of CUES items and scales and other Psychometric 
properties of the instrument; (3) establish a wider network of 
relationships between CUES scores and a variety of other 
institutional characteristics; and (4) give the National Opinion 
Research Center (NORC) information about college environments which 
would enable them to probe more deeply into the determinants of 
educational and career choices of college students. One hundred 
institutions served as a national reference group for the 
psychometric studies. Eight types of environments were identified. 

The psychometric properties of the current edition of CU W S were found 
to be generally adequate but capable of improvement. (A r ) 
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INTRODUCTION 



College & University Environment Scales (CUES), an instru- 
ment for characterizing the perceived atmosphere of higher insti- 
tutions, was published by Educational Testing Service in 1963. 

The instrument was an outgrowth of previous analyses, made by the 
author, of the College Characteristics Index (CCI) . In 1958-59, 
the CCI had been used by some 50 or 60 institutions, and from 
these reports a tentative norm group of 32 colleges and universi- 
ties had been selected. When the data were analyzed to show the 
major dimensions along which institutions differed, using the mean 
score of institutions as the unit of analysis rather than scores 
of individual students, four factors, or directions of environ- 
mental press, seemed to emerge; an intellectual, humanistic, es- 
thethic press; a friendly, group welfare press; a scientific, in- 
dependent press; and a practical, status-oriented press ( 15 ) • 

During the yearj 1960-62, as CCI data from more institutions be- 
came available, it became possible to base analyses on a better 
cross-section of institutions and thus to see more clearly the ways 
in which institutions differed. These analyses led to the devel- 
opment of CUES, replacing the CCI. About half of the CCI items 
were found to be non-functional in the sense that they failed to 
discriminate between institutions, and the items which did dis- 
criminate fell along five dimensions subsequently labeled 
Practicality, Community, Awareness, Propriety, and Scholarship. 

With the publication of CUES by ETS many more institutions as well 
as individual researchers became interested in studies of college 
environments . 

It seems reasonable to say that CUES has further stimulated 
the curiosity of researchers and educators. It has apparently 
tapped concepts and variables which social scientists have wanted 
to deal with but have heretofore lacked the instrumentation for 
doing so. Moreover, the initial promise of the CCI, and its 
subsequent realization in the clearer structure of CUES, stimulated 
other social scientists to explore other ways of characterizing 
college environments. Over the past ten years a substantial lit- 
erature has developed around concepts and measures of the college 
environment [Pace and McFee (22); Pace (16); Michaels (1A)]. In 
the fall of 1966, the present writer prepared an article on the 
college environment for inclusion in the Fourth Edition of the 
Encyclopedia of Educational Research, scheduled for publication 
in January 1969. This is a new topic for the Encyclopedia, and 
its appearance testifies to the salience this line of research 
has attained in the past decade. 
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Basically, one can identify four systematic approaches to 
the description and measurement of college environments. The in- 
itial concept, illustrated by the work of Pace and Stern (23), 

Pace (16), Thistlethwaite (26), Kirk (10) can be described as the 
collective perception or image approach. What do people perceive 
as characteristic of the environment? A second approach, illus- 
trated by the work of McConnell and Heist (12), As tin and 
Holland (4), Trow (28), asks a different question: What kind of 
people live in the environment? The assumption here is that 
students make the college, and that by knowing the characteristics 
of students one can infer the characteristics of the environment. 

A third approach is a demographic one. What demographic features 
are characteristic of the environment? Features such as size, 
money, library resources, proportion of men and women, faculty- 
student ratio, etc. are examples. Astin (1) and Richards(25) 
have used this approach , A fourth kind of question has been; 

How do people behave in the environment? The most recent studies 
of Astin (3), and the earlier participant-observer methods of 
Becker (5 ) illustrate this approach. As alternative approaches 
have been used, the investigators have compared their results with 
those obtained from the CCI or CUES, using such comparisons as 
partial evidence for the validity of their methods. To some ex- 
tent, then, the CCI and CUES have served as a central reference 
fcr much of the research over the past decade. Although each 
approach produces some unique results, the similarities in con- 
clusions obtained by various methods are quite apparent. All of 
the investigators find dimensions or scales which have some simi- 
larity to one or more of the five scales in CUES--the magnitude 
of these similarities being expressed by correlations in the .40s 
to .60s. 



Regardless of the method of inquiry, the accumulated results 
show very clearly that college environments differ greatly from 
one another. In educational and psychological research there is 
ample evidence that different treatments produce different results 
that different stimuli produce different responses. Rather com- 
monly, when significant differences are not obtained, the treat- 
ments have not been substantially different in the first place, 
or the outcome measures have been only partially relevant to the 
differential treatments. It is not surprising that large signifi- 
cance is rarely found in small phenomena. College environments, 
however, are large phenomena; and the differences between them 
are also demonstrably large. Theoretically, the effects of such 
different environments should be easily documented by empirical 
studies. In a study of nine colleges, the present writer (17) 
demonstrated that students 1 attainments of relevant objectives was 
definitely related to the environmental press of the college and, 
to a lesser extent, to the press of subcultures within the college 
Two recent dissertations at UCLA [Dean (8); Fisher (9 )] showed 
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that the magnitude of entering students 1 misperceptions about the 
environment was clearly related to how well they subsequently 
liked the environment, and to the frequency with which they ex- 
perienced some difficulty in adapting to it. A similar finding 
was reported by Pervin (24). In the NORC studies, students 1 
career plans were influenced by certain aspects of the college 
environment [Davis (7)]. Similar college effects were also 
shown by This t lethwaite (27). Most of these studies have used 
limited criteria — such as students 1 plans to enter graduate 
school: or have used self-report data— such as students' estimated 
progress toward various objectives, or estimated satisfaction 
with college. Until there ^re large-scale studies , using criterion 
measures relevant to a variety of educational objectives, the full 
impact of different environments on different students cannot be 
adequately demonstrated. One might add, too, that measures of the 
environment which are based upon projections from the character- 
istics of students cannot really be used to sort out the relative 
influence of personality v£ environment upon subsequent outcomes. 
CUES, as a measuring instrument, is relatively free of this kind 
of contamination. What students collectively perceive to be char- 
acteristic of their college environment has little or no relation- 
ship to the personal characteristics of the students themselves 
[Pace (18); McFee (13)]. 

Any national assessment of the effectiveness of higher educa- 
tion must deal, somehow, with at least three fundamental problems: 
first, the diversity of objectives and purposes across the full 
range of higher institutions, necessitating a set of criterion or 
outcome measures which properly reflect and acknowledge this di- 
versity; second, the differences between college environments, 
necessitating the use of suitable measures for describing and 
classifying some of the major ways in which educational treat- 
ments differ from one another; and third, the range of student 
abilities, backgrounds, interests, and aspirations, necessitating 
the use of test data and other information to identify what kinds 
of students are given what kinds of treatments, and attain what 
kinds of objectives. The present study is addressed to the second 
of these three fundamental problems. 



Purposes of the Present Inquiry 

The present study is not a research project in the usual 
sense of testing some hypothesis. Rather 5 it is basically a 
normative survey* Since CUES is probably the most widely used of 
the current instruments for describing college environments, the 
norms which can be provided, and other guidelines which might aid 
in its interpretation, are of some consequence to many people, 
both educators and researchers. Conclusions about higher education. 
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based on any such instrument, depend on the goodness of the in- 
strument itself. The first purpose of the study, then, is simply 
to provide more up-to-date and more adequate national norms — docu- 
menting mere fully the range of institutional diversity on each 
of the items and scales in CUES and the varieties and major types 
of institutional profiles. 

The second purpose is to undertake a thorough reanalysis of 
CUES items and scales and other psychometric properties of the 
instrument. It is important to know, for example, whether the 
present scales, Ived initially from factor analyses and item- 
criterion correlations in a group of 50 institutions that had 
used the CCI, can be cross-validated. Do the same factors emerge? 
Are some items no longer useful? How reliable are the scores? 
Should the scoring system be modified? Should new items be in- 
troduced? The purpose here is simply to improve the instrument 
as a measure, to the extent that improvement is warranted. 

The third purpose is to establish a wider network of rela- 
tionships between CUES scores and a variety of other institutional 
characteristics. This is an exploration of CUES validity and thus 
of its interpretation. 

A fourth purpose is to give the National Opinion Research 
Center information about college environments which will enable 
them to probe more deeply and significantly into the determinants 
of educational and career choices of college students. By adding 
CUES data to the wealth of information accumulated by NORC, one 
can enable NORC to study the informal environmental influences 
on students 1 choices in relation to such other potential influences 
as student characteristics, social backgrounds, and the formal 
organizational aspects of the colleges. 




4 



METHOD 



Selection of Inc ti tut ions to be Studied 



The National Opinion Research Center had undertaken two large 
surveys of the educational and career plans of college students, 
and had published results from the first of these surveys under the 
title of Great Aspirations at th° time the present research pro- 
ject was undertaken. A second survey had just been made. The 
first was addressed to the June 1961 graduates of a cross-section 
of 135 colleges and universities. The second survey was of the 
June 1964 graduates of 200 institutions. Since a great deal of 
information was known about both the students and the institutions 
included in these NORC surveys, and since both surveys included 
a great variety of institutions, the present survey of college en- 
vironments would obviously be enriched by using many of these same 
institutions so that the previously collected NORC data could be 
utilized along with the new data from CUES. At the same time, the 
NORC staff had indicated a special desire to add to their pending 
analyses the kind of information about college environments which 
the responses to CUES items could provide. An agreement was 
made to share data with NORC* 

There were 313 different schools included in the two NORC 
surveys, some schools having been included in both studies. Among 
these 313 there was a special sub-set of Negro schools which were 
eliminated from the present study. Also, there were a few others 
which were deliberately omitted for special reasons (for example, 
the University of Puerto Rico, one Hebrew teachers college, etc.). 
There remained 260 to be considered. Of the 260, responses to 
CUES items had previously been obtained from 45, and there were 
an additional 11 from which data were expected through other 
sources, leaving 204 from which data would be sought in the present 
survey. Actually, invitations to participate in the national study 
of college environments were sent to 193 colleges and universities. 
Of this number, 124, or 64 per cent, did participate by adminis- 
tering CUES to a sample of their students. Since we already had 
data on 45 of the NORC sample schools, the addition of 124 made 
a total of 169 out of 260, or 65 per cent. 

The present study was not limited to schools from the NORC 
samples. Rather, the NORC list was used as the primary source for 
collecting additional data. We already had in our files reports 
from 59 other colleges and universities, and these schools along 
with still others obtained during the year gave a grand total of 
237 to use in subsequent analyses . 
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Selection of Samples of Students 



The letter inviting participation in the national survey of 
college environments and other material describing the terms of 
participation and suggesting procedures for obtaining samples of 
students, are reproduced in the Appendix. Briefly, the invitation 
material specified the number of CUES booklets and answer sheets 
that would be sent to the institution; indicated the minimum num- 
ber of students to be tested; required the school to obtain a 
reasonable cross section of students (excluding freshmen or recent 
transfer students) drawn from the sophomore, junior, or senior 
classes, preferably upperclassmen; and further specified that they 
be selected so as to include men and women in a representative 
fashion; and, for the complex schools, to include a proportionate 
number of students from different major academic programs such as 
Engineering, Business, Liberal Arts , etc. 

The number of students to be tested was related to f-he size 
of undergraduate enrollment. Enrollment figures were obtained from 
directories, and the following categories were arbitrarily drawn: 

Undergraduate Enrollment Number of Students to be Sampled 



In all of the 124 colleges and universities that were invited 
to administer CUES, and did so, the number of cases obtained was 
within the range noted above. A report form to be filled out by 
the school representative and returned with the completed answer 
sheets provided space to describe how the students were selected. 
Most commonly, the tests were administered to students in a selected 
cross-section of courses, a selected cross-section of living units, 
or mailed to a random cross-section. There were no instances in 
which the students tested could be regarded as clearly unrepre- 
sentative. Altogether, in the 124 colleges and universities, 
responses were obtained from 15,286 students. 

The participating schools ordered the required materials 
from Educational Testing Service and returned the completed an- 
swer sheets to ETS for scoring. After the tests were scored, the 
school received from ETS a print-out showing for each item the 
per cent of students answering it in the keyed direction, and the 
score for each of the five scales in CUES, Along with the test 
booklets, ETS also sent a copy of the CUES manual so that the par- 
ticipating schools had normative information for interpreting the 
results. A copy of the ETS print-out was sent to National Opinion 
Research Center and to UCLA. 



Under 1000 
1000 to 5000 
5000 to 10,000 
Over 10,000 



50 to 75 
75 to 150 
150 to 225 
225 to 350 
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Preliminary Psychometric Studies of CUES 



Approximately two- thirds of the 124 schools in the NORC sam- 
ple which ultimately participated in the study administered C ES 
to their students in the Spring of 1965 . Some of these resu ts , 
along with data from schools not in the NORC sample, were a ail- 
able for preliminary study in the Summer of 1965. 

Our initial concern was simply to note whether the c i.suribu- 
tion of scores on the various scales was generally similar to the 
distributions obtained several years ago from the 50 schools used 
for norms in the CUES preliminary technical manual. We discovered 
that on most scale s --Community, Propriety, Awareness, and Scholar- 
ship--the new scores were characteristically lower than the ones 
obtained for the earlier sample of schools, resulting in distri- 
butions which tended to pile up at the lower end, and mean scores 
which, instead of being 10 or 11 points, were now 8 or 9 points. 
The results, of course, might be due to some differences in the 
types of schools; and, in fact, the new data included a heavier 
representation of State Colleges, and large, but not highly selec- 
tive, public universities, than had previously been available. 

This led to experimenting with an alternative method of scoring 
CUES, in the hope that a better spread of scores would be obtained 
Instead of counting only those items which were answered by a con- 
sensus of two to one or greater in the keyed direction-- the so 
called 66%+ method of scoring--we counted all items which were an- 
swered by a two to one majority in the keyed direction and also in 
the opposite direction, then adding a constant to eliminate nega- 
tive scores. This produced a substantially better distribution 
and we subsequently decided to incorporate this new scoring method 
when a revised edition of CUES is produced.. 

Our main concern in the preliminary studies was to learn 
more about the extent to which college and university environments 
might be grouped into several more o:c less homogeneous types. If 
there were such types, then the ultimate selection of schools for 
a new norm group should reflect them. Using computer programs 
developed by Dr. James MacQueen (11) we analyzed three sets of 
data. The data consisted simply of the five CUES scores for each 
school; and the program was designed to identify profile similari- 
ties. Basically, the computer program takes the first profile 
(set of five scores) presented to it and then identifies other 
profiles that are within any specified distances from it; when no 
other profiles qualify for the first cluster, a new cluster is 
started, with the program continuing until a previously specified 
number of groups are identified. This type of computer program 
was used, with alternatives in the specifications, on the 77 
schools having new CUES data, also on a total group of 174 schools 
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which Included many from which data had been obtained in previous 
years, and finally on this same large group with 30 junior colleges 
added. On some of the program variations, the number of clusters 
was gradually reduced so that one could see which institutions 
shifted to any new group. Also, on some of the programs, a simi- 
larity index was produced for each school within a cluster so that 
we could see which schools were most and least like the modal 
school in the cluster. Altogether five sets of cluster analysis 
output were studied. 

The results of these preliminary cluster analyses are sum- 
marized in the present section on "Methods" because they are pre- 
requisite for explaining later the method for selecting the final 
list of 100 colleges and universities that were used for developing 
new norms, and all other psychometric studies of CUES. In all the 
cluster programs there emerged a group consisting primarily of 
highly selective, private, non-sectarian , liberal arts colleges-- 
such as Vassar, Bryn Mawr , Wesleyan, Williams, Pomona, Oberlin, 
Antioch, Reed, etc. Overlapping occasionally with this group so 
far as specific schools were concerned, was a second cluster con- 
sisting primarily of highly selective universities, public and 
private--8uch as Princeton, Johns Hopkins, Michigan, Wisconsin, 

ULCA, etc. A third cluster which always emerged with reasonable 
clarity was composed mainly of schools having dominant programs 
in engineering and sciences--such as Carnegie Tech, Harvey Mudd, 
Purdue, South Dakota Mines, Illinois Institute of Technology, 
etc. A fourth type which usually grouped together was mostly com- 
posed of small strongly denominational schools--such as many 
Catholic women's colleges, and colleges affiliated with minor rather 
rather than major Protestant sects (Mennonite, Evangelical 
Lutheran, Southern Baptist, Churches of Christ, etc.). Some other 
liberal arts colleges, and occasionally a teachers college, fell 
into this group, but its main component was always the strongly 
denominational emphasis. A fifth group, less clear than the pre- 
vious four, typically consisted of teachers colleges, assorted 
liberal arts colleges, and some State Colleges. For the most 
part, some emphasis on teacher training programs provided the com- 
mon denominator. When junior colleges were added to the input, 
most of them emerged in a common cluster. The above five (or 
six) if junior colleges are courted) clusters usually accounted 
for about half of the institutions in the different samples 
studied. The remainder, consisting of what we later came to des- 
cribe as general universities, general liberal arts colleges, and 
State Colleges, grouped themselves in various ways depending in 
part on how many clusters the computer program was instructed to 
form. In one of the program outputs there were two clusters com- 
posed chiefly of assorted schools from the Southern states, and 
to some extent of universities (not highly selective) in non- 
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metropolitan areas. In another program, designed to produce 12 
clusters, one was mainly Southern state colleges plus five Southern 
teachers colleges, a second was mainly non-metropolitan universi- 
ties and State Colleges not in the South, and a third was a com- 
posite for which no general characteristic could be ascribed. 

From the cluster analyses, however, we saw that at least five 
fairly homogeneous types always emerged (six if junior colleges 
are added); and concluded that these types should certainly be 
considered in ultimately chosing a new norm group for CUES, for 
they represented distinctive classes of American colleges and uni- 
versities . 



Selection of a National Reference Group 

After data had been received from all 124 schools on the NORC 
list which had agreed to administer CUES, and adding to this num- 
ber other schools which had administered CUES during 1964 or early 
1965 and from which we had received reports, there were approximately 
175 institutions to draw upon in developing a new reference group 
for the further analysis and interpretation of the test. 

In the initial CUES manual, the norm grotp was built around 
the following categories or stratifications — four geographic areas 
(Northeast, South, Midwest, and Mountain and Far West); three 
levels of program (USOE types II, III, and IV: i.e^ BA only; BA, 

MA and first professional; and BA, MA, FhB and advanced profes- 
sional); and public and private control. Then, the number of 
institutions in each cell was approximately proportionate to a 
national distribution of enrollments: for example, if half of 

all college students are in large complex universities (USOE type 
IV), then half of the institutions in the norm group should be 
large complex universities. The alternative procedure would have 
been to use a national distribution of institutions as the guide- 
line, in which case most schools in the norm group would be small 
liberal arts colleges and relatively few would be large complex 
universities . 

For the new norm group we decided to use a compromise be- 
tween these two procedures. We took as a baseline the national 
population of four-year accredited institutions (omitting junior 
colleges, non-accredited schools, and other special cases such as 
military academies). Then, using the categories of region, level, 
and form of control, we determined how many schools out of 100 
would fall in each cell of this grid under two different condi- 
tions— to be representative of institutions and to be repre- 

sentative of enrollments. The resulting distributions are shown 
in Table 1. At levels II and IV the two distributions are almost 
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Table 1 



Theoretical Distribution of Colleges and Universities-- 
Representative of Institutions and Representative of Enrollments 
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mirror images of one another. To be representative of the number 
of institutions in the country , there would be 53 at level II and 
15 at level IV. To be representative of a distribution of enroll- 
ments , there would be 16 institutions at level II and 52 at level 
IV. With respect to the number of public and private institutions 
there are also large differences depending on which basis for rep- 
resentation is used. Neither basis can be defended as the the 
only proper one to use in determining a norm group for college 
environments. It can be argued, however, that a norm group for an 
instrument such as CUES should include a reasonable number of 
every major type of environment so as to provide a maximally re- 
liable basis for studying institutional dif ferer :es „ 

The objective, as we saw it, was to select a national assort- 
ment of colleges and universities that would reflect a broad cross- 
section of American higher education--from all parts of the country, 
large and small, public and private--and would at the same time in- 
clude representative institutions for each of several categories 
or types which are known to differ substantially from one another. 
Lnat institutions should be included in such a baseline is a ques- 
tion to which there is no one right answer; and the common prac- 
tice of drawing a random sample really begs the question. The 
word baseline, rather than sample, suggests a crucial difference 
in point of view. In economics, for example, :he Gross National 
Product or the Cost of Living Index or the Dow- Jones averages are 
not based on a national sample of anything; instead they are based 
on a rationally selected set of categories which presumably rep- 
resent significant elements of th<? economy. The result is not a 
sample; it is a baseline or standard reference. This is precisely 
what we attempted to do in developing a new norm group for CUES. 

From the cluster analyses described previously we decided that 
eight general types or categories of institutions must be repre- 
sented in a national reference group. Since we ultimately wanted 
to examine the homogeneity within types and “Tso the differences 
between types, we arbitrarily decided that for a total norm group 
of 100 institutions, we should have at least ten institutions in 
each category. This still enabled us to have 20 institutions in 
the two largest categories. Then, within this limitation of the 
eight categories we would select schools in such a way--by region, 
level, and form of control-- that the resulting national distribu- 
tion would approximate a mid-way compromise between the institu- 
tional and enrollment distributions shown in Table 1. The extent 
to which the final selection of 100 Institutions met this com- 
promise is shown in Table 2. The compromise or desired numbers 
in each cell are simply the average of the two numbers in the cor- 
responding cells of Table 1. These compromise numbers are compared. 
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Table 2 



Desired Compromise Distribution and Obtained Distribution for 
a National Reference Group of College Environments 





NE 




MW 




S 




FW 




Total 








C 


0 


C 


0 


C 


0 


C 


0 


c 

1 


0 






II 


















1 








Public 


1.5 


1 


1 


0 


2.5 


1 


0 


0 


5 


2 i 


-34.5 


28 


Private 


8 


6 


10.5 


11 


8 


5 


3 


4 


29.5 


26 J 






III 


























Public 


4.5 


3 


3 


5 


5 


5 


1 3 

i 


3 


15.5 


“1 


>31.5 


34 


Private 


6.5 


6 


4 


7 


3 


2 


2.5 

1 


3 


16 


18 J 


1 




IV 














i 












Public 


4 


3 


7.5 


8 


6 


6 


i 4.5 


6 


22 


231 


. 33.5 


38 


Pr ivate 


7 


9 


1.5 


4 


1.5 


1 


! 1 * 5 


1 


11.5 


is) 


I 




Total 














1 

f 












Public 


10 


7 


11.5 


13 


13.5 


12 


! 7 - 5 


9 


42.5 


41 






Private 


21.5 


21 


16 


22 


12.5 


8 


' 7 


8 


57 


59 






Total 


31.5 


28 


27.5 


35 


26 


20 


\ 14.5 


17 


99.5 


100 










C « 


Desired number 


if sample is 


a 


midway 









compromise between a distribution of 
institutions and a distribution of 
enrollments . 

0 ® Obtained number used in national base- 
line for CUES norms* 
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in Table 2, with the numbers actually obtained and used in the 
national reference group for the present study. The compromise 
numbers and obtained numbers are, with very few exceptions, very 
close to one another. 



The eight categories, and the specific institutions in each, 
are listed below: 



(SLA) 



(SU) 



10 Highly Selective Liberal Arts Colleges 
Oberlin Pomona 

Radcliffe Cornell 

Antioch Chatham 

Earlham Beloit 

Williams Reed 



10 Highly Selective 
Clark 

Johns Hopkins 
UCLA 

Pennsylvania 
North Carolina 



Universities — Public ard Private 
Princeton 
Wisconsin 
Michigan 

Washington (St. Louis) 
Stanford 



(GLA) 



(GU) 



20 General Liberal Arts Colleges 



Knox 
Albion 
Lake Erie 
Oglethorpe 
Birmingham Southern 
Blackburn 
Lycoming 
Washington and 
Jefferson 
Colgate 
Lafayette 



Mary Washington 

Rollins 

Monmouth 

Lambuth 

Westmont 

Wittenberg 

Simons 

Ripon 

Denison 

Colby 



20 General Universities-- 
St. Louis 
Kansas State 
(Manhattan) 
Rutgers 
Tul t ne 
Utah 
Howard 
Oregon 
Penn State 
Wayne State 
Northwestern 



Public and Private 
St. Lawrence 
Nebraska 

Georgia 
Colorado 
Michigan State 
Texas Christian 
Alabama 
New Hampshire 
South Carolina 
Wyoming 
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(SC) 


10 State Colleges and Other 


Universities 




Western Michigan 


San Diego State 




Texas Western 


Brooklyn College 




Memphis State 


San Francisco State 




Mississippi State 


Texas Technological 




Oregon State 


La Salle (Philadelphia) 


(TC) 


10 Teachers Colleges and Others with Major Emphasis 




in Teacher Education 






Kansas State 


Ball State 




(Emporia) 






Slippery Rock 


Marshall 




Monte lair 


Eastern Oregon 




Central Connecticut 


Southeastern State Collt 






(Oklahoma) 




Troy 


State College of Iowa 






(Cedar Falls) 


(Den) 


10 Strongly Denominational 


Liberal Arts Colleges 




Oklahoma Baptist 


St. Catherine 




Pepperdine 


Manhattanville 




31uf ton 


Carroll 




Susquehanna 


Mount St. Marys 




Manchester 


Spring Hill 


(ES) 


10 Engineering and Sciences 






Pur due 


Iowa State (Ames) 




Illinois Institute 


Carnegie Tech 




Harvey Mudd 


Wabash 




South Dakota Mines 


Rose Polytechnic 




Brooklyn Polytechnic 


Re ns s e laer 


The total 


number of students tested at these 100 institutions 



was 15,395. 
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O 

ERLC 



Further Psychometric S tudies of CUES 



All subsequent analyses of the test are based on the data from 
the above group of 100 institutions. The results of those analyses 
are described in the next section. The following studies were made: 

1. Factor analysis of items within each of the five scales 
(BiMed 03M, Kaiser Verimax Rotation to 8 factors) . 

2. Factor analyses of the total tes t--divided into equivalent 
thirds. (Same program as above.) 

3. Item discrimination studies: Correlation of all items with 

each of the five scale scores, and by two different scoring methods. 

4. From the above analyses, selections of items to be retained 
in the revised test. At this point, the 150 items were reduced to 
100 items, divided into five scales of 20 items each. 

5. Rescoring the 20-item scales, using the revised method of 
scoring . 



6. Final item discrimination studies: Correlation of all items 

with each of the five revised scale scores. 

7. Final factor analysis (same program as above) of the total 
test divided into equivalent halves. 

8. Development of norm tables (percentiles) for the revised 

tes t . 

9. Graphic representation of score ranges for each of the eight 
types of institutions. 

10. Selection of new items for tryout in the revised edition 
of CUES. 



Validity Studies 

NORC provided us with the aggregate student responses from 
all institutions in their studies--both for the 1961 survey and the 
1964 survey. We correlated these data with CUES scores in two sepa- 
rate samples--f irst with however many schools in our reference group 
of 100 were also in either of the NORC surveys, and second, with 
all institutions for which we had common data. In addition, we 
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correlated CUES scores for all 100 of our reference group with the 
EAT input and environmental variables published in As tin* s book, 

Who Goes Where to College? (2). Further, for all schools which 
reported Scholastic Aptitude Test scores in the College Board's 
Manual of Freshman Test Profiles (1964) and which were also in our 
group of 100, we correlated CUES scores with SAT Verbal scores. 

And finally, for all colleges which had been included in Astin's (1 ) 
study of institutional characteristics and were also in our sample, 
we correlated CUES scores with Astin's factors. All these relation- 
ships, totalling several hundred correlations, constitute a signifi- 
cant expansion of the validity network for CUES. 



O 

ERLC 
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RESULTS 



Psychometric Data 

The re-study of CUES as a measuring instrument led to the 
following decisions: 1) to retain the five basic scales of the 

present instrument, 2) to improve the psychometric properties 
of these five scales by eliminating the weakest items, shortening 
the test from five 30-itera scales to five 20-item scales, and 
3) t:o use a revised system of scoring. The data which led to 
these decisions are presented in this section, followed by a re- 
port of the psychometric properties of the revised test. 

In the preliminary technical manual for CUES, the method of 
obtaining an institution's score on each of the scales is simply 
to count the number of items answered in the keyed direction by 
a consensus among the respondents of two to one or greater. Thi 
any item about which 66 per cent or more of the students agree 
(in the keyed direction) is counted in the score. The logic of 
CUES is to identify the collective perception of qualified re- 
porters about what is and is not characteristc of the environment. 
The two to one consensus (or 66%+ method of scoring) is an arbi- 
trary dividing line, saying in effect that in order to regard a 
condition as "characteristic" there should be at least this much 
agreement about it. The distribution of scores of the 48 schools 
reported in the preliminary CUES manual was such that the median 
scores on the five scales were 11, 11, 12, 10, and 11. The dis- 
tribution of scores for the new reference group of 100 schools, 
however, showed median scores of 9, 11, 10, 7, and 9. Our hope 
had been that the new medians would be higher than the previous 
ones. Especially for the Propriety scale, with a median of seven 
points, the ability of the test to discriminate at the lower end 
of the distribution was seriously reduced. The possibility of a 
different method of scoring was suggested in the CUES preliminary 
manual — namely to count items about which there was a two to one 
consensus in the direction opposite to the key as well as those 
about which there was a two to one consensus in the keyed direc- 
tion. This was referred to as the "66 plus and 33 minus" method 
of scoring. Looking at the item percentages on the Propriety scale 
for some of the schools in the new reference group it was apparent 
that there ;;ere some schools in which many items had been answered 
in the non-keyed direction by two-thirds or more of the respon- 
dents. By considering these items in the scoring system, the 
distribution of scores would presumably have a better spread; and 
the piling up of scores at the low end of the scale would be elim- 
inated. So, we used two methods of scoring in our initial item 
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discrimination studies--the 66+ method and the 66/33 method. The 
latter scores were obtained as follows: 

1. Number of items answered 66 per cent or higher in the 
keyed direction; 

2. Minus number of items answered 66 per cent or more in 
the opposite direction; 

3. P lu8 a constant of 20 points (to eliminate minus scores). 

Table 3 compares the distribution of scores of the 100 schools in 
the reference group obtained by these two scoring methods. It is 
quite apparent that the shape of the distribution, on all scales, 
is better when the 66/33 scoring method is applied to the data. 

Both of these scores were used as criteria for determining 
item discrimination indexes. The item-scale score correlations 
are shown in Table 4. The table shows that every item in each 
of the five scales correlated positively with both criterion scores, 
with no correlation being lower than .20. In other words, every 
Item in each scale was discriminating among the 100 schools in 
the same direction as the scale scores. Against the 66+ scores, 
a total of 15 of the 150 items had correlations below .40 in the 
scale to which they presumably belonged; against the 66/33 scores 
there were 13 such items. 

Table 5 shows that some items in each scale had higher cor- 
relations with other scales. Of the 30 Practicality items, 22 
correlated highest with the Practicality scale scores; but two 
correlated highest with the Community scale, three with the 
Awareness scale, two with the Propriety scale, and one with the 
Scholarship scale. The table also shows that, regardless of which 
criterion was used (66+ scores, or 66/33 scores) the results are 
approximately the same. By the 66/33 method there are 121 items 
having the highest correlation in the scale to which they belong. 

By the 66+ method there are 117 such items. 

Table' 6 shows the median correlations of items with each 
scale, for both scoring methods. For example, by the 66/33 method, 
the 30 items in the Practicality scale had a median correlation 
of .60 with the Practicality scale score, a median correlation of 
.20 with the Community scale score, -.27 with Awareness, .04 with 
Propriety, and -.33 with Scholarship. Looking at both parts of 
the table, and at the correlations of items with their own scale, 
one sees that the 66/33 scoring method gives higher correlations 
in the case of the Practicality, Community, and Awareness scales, 
lower in the case of the Scholarship scale, and that there is no 
difference on the Propriety scale. In this respect the 66/33 
scoring method xs slightly preferable. In a pattern of intercor- 
relations such as this, another relevant criterion is the extent 
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Table 3 



Distribution of CUES Scores by Two 
Different Scoring Methods 





Pract 


Comm 


Awar 


Prop Schol 


Pract 


Comm Awar Prop Schol 


Score 












Score 












30 












59-60 










1 


29 










1 


57-58 






1 






28 










1 


55-56 




2 


4 




2 


27 






2 






53-54 






2 






26 




2 


2 




2 


51-52 




3 


3 




6 


25 




1 


2 






49-50 


3 


5 


9 




4 


24 




1 


3 




1 


47-48 


4 




2 


5 


5 


23 




2 


1 




1 


45-46 


1 


3 


6 


2 


5 


22 




1 


2 




3 


43-44 


4 


4 


2 


1 


3 


21 




3 




3 


3 


41- A 2 


6 


8 


6 


6 


3 


20 


2 




2 


2 


2 


39-40 


3 


12 


4 


1 


11 


19 


2 


2 


3 




5 


37-38 


7 


7 


10 


4 


6 


18 


4 




2 


2 


1 


35-36 


11 


6 


9 


3 


4 


17 


3 


3 


3 


3 


1 


33-34 


10 


7 


7 


7 


7 


16 


4 


4 


4 


2 


3 


31-32 


7 


10 


7 


9 


7 


15 




4 


1 


2 


2 


29-30 


8 


8 


7 


6 


5 


14 


2 


3 


1 


2 


2 


27-28 


6 


4 


3 


9 


6 


13 


5 


10 


6 




3 


25-26 


5 


3 


6 


12 


7 


1? 


2 


6 


2 


3 


6 


23-24 


2 


4 


6 


11 


4 


11 


10 


9 


9 


1 


6 


21-22 


5 


3 


5 


3 


7 


10 


10 


5 


4 


3 


3 


19-20 


3 


5 


3 


5 


2 


9 


8 


5 


4 


5 


3 


17-18 


5 


2 




7 


1 


8 


9 


11 


3 


11 


7 


15-16 


2 


1 


2 


2 


2 


7 


6 


7 


13 


9 


3 


13-14 


4 


1 


1 


3 




6 


6 


8 


9 


14 


12 


11-12 




1 


2 


2 


1 


5 


6 


5 


6 


5 


9 


9-^0 


2 








3 


4 


6 


4 


5 


7 


3 


7-8 


1 


1 








3 


5 


l 


6 


9 


6 


5-6 












2 


6 


2 


2 


5 


5 


3-4 












1 


1 


1 


3 


4 


5 


1-2 












0 


2 






2 


1 


0 
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to which the correlations between scales are increased or decreased. 
One hopes to obtain high correlations within scales, but generally 
low correlations between scales. Comparing the two parts of the 
table, one finds that the intercorrelations are lower for the 
66/33 scoring methoo in 14 instances ^ higher in four instances, and 
the same in two instances than for the 66+ scoring method. Thus, 
again, the 66/33 scoring method is psychometric ally preferable. 

Tables 4, 5, and 6 all indicate that some improvement in the 
test could be made by eliminating a few items — items with low item 
criterion correlation, items which correlate higher with a scale 
other than the one in which they are located, and items whose re- 
moval might help to reduce the magnitude of intercorrelation between 
some of the scales. At the same time, it is clear that the basic 
structure around which the test was developed does not need to be 
modified; for most items correlate highest where they are sup- 
posed to, and all items are positively discriminating in the scale 
to which they are originally assigned. 

Further information about the test items was obtained from 
factor analyses. No factor analysis of CUES items had previously 
been made. The dimensions or scales in the present instrument 
were derived from factor analysis of CCI scale scores, not from 
factor analysis of the individual test items. When the item res- 
ponses are factored, will the same, or basically similar factors, 
be produced? Since the population of institutions was 100 and 
since there are 150 items in CUES, we broke the test into equiva- 
lent thirds for analyses, making 50 variables (items) and 100 schools 
for each analysis. These were not random thirds. The 30 items in 
a scale were sorted into three groups of 10 items each in a way 
which made each group approximately similar with respect to item 
content and the distribution of item marginals. For each set of 
50 items (10 items from each of the five scales) the computer pro- 
gram was instructed to continue until eight factors had been pro- 
duced (Kaiser Verimax method). 

Table 7 indicates, for each factor analysis, the location of 
all items *with .40 loadings or higher. In the analysis of the first 
set of items, for example, there were 15 items having loadings 
of .40 or higher on the first factor. Nine of these 15 items were 
from the Awareness scale. The second factor was defined by 10 
items having loadings of .40 or higher, of which nine of the 10 
car:ie from the Community scale . The third factor had nine items 
with .40 loadings or higher, of which six were from the Propriety 
scale. The fourth factor, with seven items, had five from the 
Practicality scale. The fifth factor was defined by 14 items, of 
which 10 came from the Scholarship scale. The remaining three 
factors consisted of miscellaneous items. Thus, of the five de- 
finable factors produced from the analysis of the first equivalent 
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Table 7 

Location of Items with .40 Loadings or Higher 



First Equivalent Third 
Practicality items 
Community items 
Awareness items 
Propriety items 
Scholarship items 
Total 



Factors 
1 2 



1 

1 

4 

15 



1 

(3 



3 

2 

1 

<§> 



4 

© 

1 



10 



© 

7 14 



6 

2 



1 

1 

2 



Second Equivalent Third 
Practicality items 
Community items 
Awareness items 
Propriety items 
Scholarship items 
Total 



J. 

3 

1 

2 



<5> 

11 



2 

2 

2 

3 

l 

8 



3 

0 

3 



10 



4 

1 

© 

1 

4 

1 

12 



5 

4 

0 

1 

12 



1 8 

1 

1 1 

1 1 

2 ® 

<S> _ 

9 9 



Third Equivalent Third JL 2 3 4^ J> 

Practicality items 4 1 (?) 2 

Community items 5 3 

Awareness items ( 9 ) 1 1 

Propriety items 1 1 1 

Scholarship Items _ _ J. 

Total 17 13 10 9 9 



7 8 



1 2 

3 3 
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third of the test items , it is clear that these factors consist 
predominantly (71 per cent) of items from the same scales around 
which the test was originally organized. 

When the data for each of the three factor analyses are added, 
putting together from each of the thirds those factors which are 
clearly similar, the following results are obtained, as shown in 
Table 8. No other combination of factors from the three analyses 
will produce a more concentrated or readily discernable pattern; 
and the pattern which does emerge is more similar to than dif- 
ferent from the basic pattern of the original test. In the five 
main factors from the new analyses, 60 per cent of the items with 
.40 loadings or higher reflect the original five factors; but this 
leaves 40 per cent which do not. There were, of course a number 
of items which had loadings of .40 or higher on more than one 
factor . 

A sharper picture of the new factor analyses is seen in Table 
9, where the location of only the highest factor loadings is re- 
ported. For example, in the first analysis, six of the 10 items 
from the Practicality scale had their highest loadings on the 
"Practicality" factor. From the summary of the three analyses 
at the bottom of the table, the original Awareness items provide 
the clearest definition of the "new" Awareness factor, since 25 
of the 30 items had their highest loading on this factor. The 
original Practicality items are the least satisfactory, with 16 of 
the 30 having their highest loadings on what seems to be the "new** 
Practicality factor. Overall, 102 of the 150 items, or 68 per 
cent, have their highest loadings in a factor which is congruent 
with their original location in the first edition of CUES. 

Having seen that two thirds of the test items fall into one 
or another of the same five factors that characterized the original 
test structure, we then looked at each of the five scales separ- 
ately to see how much of each scale was comprised of a single domi- 
nant factor. To do this, the 30 items within a scale were fac- 
tored (Kaiser Verimax to eight factors). The largest factor on 
each of the five scales, with largest defined as the number of 
items having loadings of .40 or higher with it, typically included 
40 per cent to 50 per cent of all the items, as the following 
figures show; 
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Table 9 

Location of Highest Factor Loadings 
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Number of Items with Number of Items with 
.40+ Loadings on the .40+ Loadings on the 



Scales 


Largest Factor 


Second Largest Factor 


Practicality 


12 


8 


Community 


15 


8 


Awareness 


14 


11 


Propriety 


14 


10 


Scholarship 


12 


JS 


Average 


45% of the 


items 



There were three describable subfactorB in each of the scales. 
Beyond the three, no other subfactor in any scale consisted of 
more than two items which had not previously been accounted for 
by virtue of its having had a loading of .40 or more in one of 
the three major subfactors. The main subfactors composition of 
the scales is described as follows: 

Practicality Scale 

A. Personal and social benefits, privilege, respect--12 items 

B. Parties, fun--6 additional items 

C. Close supervision, practical- -4 additional items 

Community Scale 

A. Faculty and school friendliness-- 13 items 

B. Student together ness --5 additional items 

C. Group manners and consideration--6 additional items 

Awareness Scale 

A. Conterporary society: reform, controversy, interest--ll items 

B. Social science emphasis and facilities--6 additional items 

C. Art 8 — 7 additional items 

Propriety Scale - 

A. Consideration, caution, conscientious, ideals--14 items 

B. Personal behavior, self-control--4 additional items 

C. Absence of pranks, escapades--5 additional items 

Scholarship Scale 

A. Standards, study, challenge-- 12 items 

B. Science eraphasis--4 additional items 

C. Class atmosphere and energy--6 additional items 



Since the factor analyses of each of the five scales also pro- 
duce a complete set of item intercorrelations, we can get a further 
indication of the homogeneity of items within a scale by examining 
these intercoi re lations . In a 30 x 30 correlation table, there 
are 435 correlations between pairs of items (29 + 28 4 27, etc. ■ 
435). A set of items which is added together to produce a score 
should not have a negative correlation between any pair of items. 
Also, if item intercorre lations are very low the implication is 
that the items may not be adequately homogeneous. And, if the 
intercorre lations are very high, the items may be too homogeneous 
in the sense that many items are redundant. Table 10 summarizes 
the item intercorre lations within each of the five scales. Only 
two per cent of all the item intercorre lations were negative. If 
one sets as a standard of psychometric desirability the criterion 
that item intercorrelations within a scale should fall in the 
general range between .20 and .80, then 85 per cent of the cor- 
relations can be described as desirable. 

All of the psychometric data presented thus far was used in 
selecting the best items for retention in a revised edition of 
CUES. In chosing these items, the following criteria were used: 

1. The retained items should have good positive correlations 
with the score on the scale in which they are located--if possible, 
an item-scale score correlation of .40 or higher, 

2. The retained items should have a higher correlation with 
the score on the scale in which they are located than with any 
other scale score. 

3. The retained items should have a loading of .40 or higher 
on the factor in which they are classified. 

4. The retained items should have a higher loading on the 
factor in which they presumably belong than on any other factor, 

5. There should be no negative correlations between any 
pair of items in a scale. 

6. The average per cent agreeing with the keyed response 
across the sample of 100 colleges should be at least 10 per cent 
and not higher than 90 per cent-- that ic , neither too rare nor 
too common a characteristic of college environments, 

7. There should be a reasonable srread in the item marginals 
across the population of 100 co lleges--specif ically , a standard 
deviation for the distribution of percentages of at least 10 points, 
and preferably 15 points or more. 
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Distribution of Intercorre lations of All Items within a Scale 
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Not all of these criteria could be met. Moreover, we also 
imposed non-8 ta tis tica 1 criteria in making the selections. A few 
items, although psychometric ally adequate, were out of date in the 
sense that their meaning or their relevance had changed. Other 
items were rejected simply because we did not like their content, 
or because their interpretation was too ambiguous. Overall, 
however, the extent to which the test ha3 been improved is clearly 
evident in the data to be reported next. 

Table 11 shows the distribution of mean percentages in the 
sample of 100 colleges for the items retained in CUES. None of the 
percentages is higher than 90 nor lower than 10. Three items had 
average marginals lower than 20 and two had average marginals of 
80 or higher. In short, all but five items, or 95 per cent of 
the total number of retained items, had average marginals some- 
where betveen 20 per cent and 80 per cent. This result satisfies 
quite well one of che criteria for item retention noted above. 

Table 12 shows the standard deviations of the distribution of 
item percentages in the 100 colleges. All but three of these sig- 
mas meet the minimum criterion noted above. At the same time, there 
are a total of 25 items with sigmas less than 15. In general, the 
larger the sigma the better the item. Even with a sigma of ten, 
however, a third of the institutions would presumably differ from 
one another by more than 20 percentage points. 

Table 13, showing the distribution of item-scale score cor- 
relations between the retained items and the revised 20-item 
scale scores, can be compared with Table 4 which presented similar 
information prior to selecting the best items. For the retained 
items no correlation between an item and its scale was less than 
.40 



Table 14 also can be compared with its earlier counterpart. 
Table 5. Previously, about a third of the items had higher cor- 
relations with some scale other than the one in which they were 
located. In the new test, there are only two such items. On 
three scales, all items now have their highest correlation with 
the scale in which they belong . There was one Practicality item 
which had a larger negative correlation with the Scholarship 
scale than a positive correlation with the Practicality scale. 

The difference in the correlations was .03. The item was put 
in the Practicality scale because the wording was descriptive of 
Practicality; and we chose to score it positively under the head- 
ing of Practicality rather than to score it negatively under the 
heading of Scholarship. On the Propriety scale, one item had a 
higher correlation with the Community score; the difference in 
the correlations was .01. It was retained in the Propriety scale 
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Table 11 



Distribution of Mean Percentages, for 100 Schools, for 
the Items Retained in the Revised Edition of CUES 



Percentages Practicality Community Awareness Propriety Scholarship 



90-99 



80 

70 

60 4 

50 3 

40 9 

30 2 

20 1 

10 1 



0-9 



1 

3 

4 6 4 

6 4 1 

4 5 8 

2 4 3 

1 2 
2 



1 

3 

4 
6 
3 
2 
1 



N 2C 



20 



20 20 20 
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Table 12 



Standard Deviations of the Distribution of 
Item Percentages in 100 Schools , Revised CUES 



Sigmas 


Practicality 


Community 


30 to 34 


2 


1 


25 


2 


3 


20 


6 


5 


15 


6 


3 


10 


4 


7 


5 




1 


0-4 

N 


20 


20 



Sea les 

Awareness Propriety Scholarship 



1 4 

8 4 3 

9 7 11 

2 3 6 

2 

20 20 20 
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Table 13 



Distribution of Item-Scale Score Correlations, CUES Revised 



Scales 

Correlations Practicality Community Awareness Propriety Scholarship 



.90-. 99 
.80 
.70 
.60 
.50 

.40-. 49 



6 

7 

7 



1 

3 

7 

6 

2 

1 



7 

6 

6 

1 



5 

3 
5 

4 
3 



8 

6 

1 

2 

1 



N 20 20 



20 20 20 
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Tab le 14 



Location of Highest Item-Scale Score Correlations: Revised CUES 



Scales 

Items Practicality Community Awareness Propriety Scholarship 



Practicality 19 

Community 

Awareness 

Propriety 

Scholarship 



20 

1 



20 



19 



1 



20 
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because the wording seemed more appropriate to that context. 

Table 15 can be compared with Table 6. The data for the re- 
tained set of items, in Table 15, shows that in all cases the 
median correlation of items with their own scale scores i» higher-- 
that is, the 20-item scales are more internally consistent than the 
30-item scales were. The median correlations of items with other 
scales indicates that the pattern of interrelationship among the 
items and scales is about the same as it was previously. The 
average correlation of items with scales other than their own is 
.20, compared with .19 previously. 

The relationships among the scales can also be shown by the 
intercorrelations of scale scores, as in Table 16. This is com- 
pared with the intercorrelation of scale scores reported in the 
CUES manual. Of the 10 correlations on each part of the table, 
those for the new revised 20-item scales are lower in eight in- 
stances and higher in two instances. Overall, the average scale 
intercorrelation in the original study was .30. In the new 
scales, this has been reduced to .25. In the previous studies, 
the Scholarship and Awareness scales correlated .63 with each 
other. The new scales correlate .56. In the old data, the 
Practicality scale had negative correlations of -.51 and -.58 with 
Awareness and Scholarship. With the new scales these correlations 
are reduced to -.34 and -.50. Thus, the interrelationships among 
the Practicality, Awareness, and Scholarship scales have all been 
substantially reduced, the average magnitude dropping from a value 
of .59 to a value of .47. In the new scales, the relationship be- 
tween Community and Propriety ie greater, now being .53 compared 
with .40 in the original study. 

The final step in studying the psychometric properties of the 
revised 20-item scales was to divide the scales into equivalent 
halves; then, to factor analyze each half, in order to see whether 
the five scales emerged successfully as factors which corresponded 
to the items in the respective scales. 

The location of all factor loadings of .40 or higher is shown 
in Table 17. For the first equivalent half of the test. Factor 
1 consists of all ten of the Awareness items, plus one other. 

Factor 2 consists of all ten of the Community items, plus four 
others. Factor 3 consists of seven Propriety items. Factor 5 con- 
sists of all ten of the Scholarship items, plus one other. Factors 
4 and 7 seem to include mostly Practicality items but no really 
clear Practicality factor is evident. Reading across the rox*s of 
the table, one finds 12 entries for the Practicality items. Since 
there are only 10 Practicality items, this means that two of the 
items had a loading of .40 or higher on more than one factor. 
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Table 15 



Median Correlations of Items with Their Own Scale Score 
and with Each of the Other Scale Scores, Revised CUES 

Items Practicality Community Awareness propr iety Scholarship 



Practicality 


,62 


.10 


-.20 


.09 


-.35 


Community 


.11 


♦ 72 


.08 


.40 


.09 


Awareness 


-.24 


.10 


.76 


.08 


.43 


Propriety 


.04 


.43 


.01 


.65 


.09 


Scholarship 


-.43 


.14 


.49 


.13 


.80 
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Intercorrelations of Scale Scores 
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Table 17 



Location of All Factor Loadings of .40 or Higher: 
Revised CUES, Equivalent Halves 



First Equivalent 
Half 

Practicality items 
Community items 
Awareness items 
Propriety items 
Scholarship items 



Factor 

12 3 4 



i 0 

© 

© i 

3 0 1 



5 6 7 8 

1 2 © 

1 1 

1 

2 2 1 

© 



Second Equivalent 
Half 

Practicality items 
Community items 
Awareness items 
Propriety items 
Scholarship items 



12 3 4 



1 2 2 

1 2 © Q) 

© 1 

© 1 

3 1 



5 6 7 8 

1 (D (3) 1 



© i 
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For the second equivalent half of the test, Factor 1 consists 
of all ten of the Awareness items plus five other items. Factor 

2 consists of all ten of the Propriety items, plus three others. 
Factors 3 and 4 locate all ten of the Community items (two of the 
encircled are duplicates), plus six other items in either Factor 

3 or Factor 4. Factor 5 consists of all ten of the Scholarship 
items, p lus two others. Factors 6 and 7 account for six of the 
Practicality items, plus one other item. Again, no clear 
Practicality factor is produced. The Community items, all of 
which have loadings of .40 or higher in either Factor 3 or Factor 
4, split in a way which put those items referring to faculty 
friendliness and helpfulness in Factor 3, and items referring to 
students in Factor 4. 

Table 18 summarizes the above duta and may be compared with 
the earlier results shown in Table 8. In every case, the factors 
produced by the revised test are mere fully and clearly defined 
by the items which presumably should define them. For example, 
on what is obviously the Scholarship factor, all 20 of the items 
classified as belonging to the Scholarship scale had loadings of 
.40 or higher on this factor, and there were only three additional 
items which loaded .40 or more on that factor. Overall, the five 
factors are defined with what might be regarded as 76 per cent com- 
pletness by the items which presumabl' should define them. This 
is a substantial improvement over the previous figure of 60 fer 
cent • 



Table 19 shows the location of the highest factor loadings 
for the revised set of items, and can be compared with Table 9. 

In every instance the composition of the factors is now more com- 
pletely defined bv the items which presumably should define them. 

The Practicality factor is defined, in terms of items having the 
highest loading on it, by 13 of the 20 items from the Practicality 
scale, or 65 per cent, compared with the previous definition by 
16 of the 30 items from the Practicality scale, or 53 per cent. 
Community is now similarly defined by 18 of the 20 items from the 
Community scale, compared with the previous definition by 20 of 
the 30 items--now 90 per cent instead of 67 per cent. The Awareness 
factor is now totally defined by items from the Awareness scale. 
Scholarship is defined by 19 of the 20 Scholarship items, compared 
with 23 of the 30 items previously. And the improvement in the 
Propriety factor is from 60 per cent to 80 per cent. For the 
revised teat, 86 per cent of the items have their highest factor 
loadings exactly where they chouid ha*’" them, compared with 58 
per cent previously. 

The exact factor loadings of the 20 items retained in each of 
the five revised scales are listed in Table 20. Practicality is 
the least satisfactory scale. It has six items with loadings of 



40 



Table 18 
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Two Community items had loadings of .40 or higher on both Factor 
and Factor 4 in the second equivalent half, hence these items we 
counted only once. 



Location of Highest Factor Loadings: Revised CUES 
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Propriety items 
Scholarship items 



Table 20 



Factor Loadings of Items Retained in Each Scale 



ticality 


Community 


Awareness 


Propriety 


Scholai 


81 


87 


87 


89 


92 


78 


85 


86 


86 


88 


72 


84 


’ 85 


85 


36 


70 


83 


83 


84 


85 


68 


80 


82 


82 


85 


61 


79 


80 


81 


83 


56 


78 


80 


78 


82 


56 


76 


77 


73 


81 


55 


75 


75 


72 


78 


54 


75 


74 


68 


74 


50 


70 


71 


67 


71 


48 


70 


68 


63 


66 


46 


64 


66 


63 


66 


44 


61 


66 


61 


65 


36 


61 


64 


48 


64 


32 


58 


62 


45 


62 


28 


58 


61 


45 


61 


24 


49 


53 


36 


56 


23 


49 


53 


35 


54 


21 


41 


47 


19 


51 
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lower than .40 with the presumed factor. The Propriety scale has 
three items with loadings of less than .40 with the presumed 
Propriety factor. In the other three scales all items have load- 
ings of .40 or higher with the factor. It seems reasonable to 
say that all of the original scales, except Practicality, have been 
verified with considerable clarity. And certainly no evidence of 
any new or different major dimensions has emerged from these analy- 
ses . Practicality, «xthough not factorially clear, nevertheless 
consists of items all of which correlated .50 or more with the 
Practicality score, so that by item analysis cr eria, the scale 
remains quite defensible. 



Normative Data 



Evidence from the psychometric data has clearly supported the 
original structure of "lUES into five scales. No new dimensions were 
produced by the new analyses. Moreover, as the scales were refined 
from 30 to 20 items, retaining the best items, it has been amply 
demonstrated that shorter scales are, psychometrically , far better 
than the origi al scales. 

Despite the fact that the new scales are shorter, they are 
also more reliable than the original scales. This is due, in part, 
to the revised scoring system which takes into account all items 
answered by a consensus of two to one or better, and in part to 
the better item-scale score correlations and the clearer factor 
structure of the scales. In the initial CUES manual we reported 
K-R 21 reliabilities, for the sample of 48 institutions, to be 
.83 , .85 , .87 , .81 , and .92. The corresponding K-R 21 reliabilities 
for the new 20-itera scales, for the reference group of 100 insti- 
tutions, are .84, .86, .89, .82, and .88. There is no real difference 
between these two sets of reliability stimates. However, when 
we compute K-R 20 reliability estimate^, instead of K-R 21, and 
thus use a calculation which conforms more adequately to the test 
conditions, the results for the group of 100 institutions are as 
follows: Practicality .94, Community .95, Awareness .96, Propriety 

.93, and Scholarship .95. 

The distribution of scores, for the 100 schools in the reference 
group, is shown in Table 21. The scores in the Awareness and Scholar- 
ship scales have the greatest spread. The Propriety scale extends 
over a range of 28 points; and the Practicality and Community scales 
extendover a range of 31 points. On a 40 point scale, the theoreti- 
cally desirable mean score would be 20 points. The actual means 
for the five scales are within approximately four points of this 
ideal, being, in round numbers, 19, 25, 20, 17 and 24. The standard 
deviations of these scores, ranging in round numbers from seven to 
nine points, are such that all or nearly all scores fall within a 



44 



Table 21 



Distribution of Scores of 100 Schools; Revised CUES Scales 



Ccores 


Practicality Community 


Awareness 


Propriety 


Scholarship 


40 










1 


39 






1 
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38 




2 


1 






37 
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2 
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36 




1 


2 
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35 




2 
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34 
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3 
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33 
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3 
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32 
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3 
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31 


2 
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30 
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29 
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28 


5 
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27 


2. 


7 
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26 
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25 
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24 
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5 
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4 


23 
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22 
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2 
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2 


21 


5 


5 


7 
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8 


20 
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5 


4 
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19 
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3 


3 


4 


4 


18 
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17 
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16 


8 
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15 
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14 
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13 
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7 




12 


2 
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11 
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2 
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10 
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3 
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2 
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4 
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6 
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5 
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1 
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1 




1 






2 


1 




1 






N 


100 


100 


100 


100 


100 


Mean 


18.95 


24.61 


20.22 


16.55 


24.07 


Sigma 


7.41 


7.59 


8.70 


6.92 


8.15 
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range of two sigmas on either side of the mean. 

The percentile equivalents for these raw scores are presented 
in Table 22. These are not normalized percentiles, they are raw 
score percentiles, or, since the number of cases is 100, cumulative 
frequencies. On the Practicality scale, the table indicates, for 
example, there there is one school (one per cent) with a score 
of two points or below, two schools (two per cent) with scores of 
three or below, four schools (four per cent) with scores of four 
or below, etc. 

The distribution of raw scores for each of the eight types of 
institutions included in the norm group is shown in Figures 1 to 
5. In drawing these graphs we have followed two policies: first, 

for each of the scales, the institutional types are presented in 
descending order from highest to lowest mean score; and second, we 
have left certain deviant cases outside the enclosed bars. It can 
be argued, we believe, that a truer picture of what the environ- 
ments of a given type of college are like is gained by excluding an 
occasional deviant case. In Figure 1, showing scores on the Prac- 
ticality scale, all the Teachers Colleges (TC) have scores which f< 
within a fairly narrow segment of the scale. The State Colleges 
(SC) however, have one score which is seven points lower than the 
next highest score, and this is counted as a deviant case. Al- 
though the total range of scores on the Practicality scale for the 
institutions we classified as State Colleges was 24 points, most 
of the colleges (nine out of ten) fell within a range of 17 points. 
In a sense, one can regard the so-called deviant case as an error 
in classification. The term "wild shot** is used by Tukey (29) in 
discussing such cases. In relation to the shape of the distribu- 
tion they are Surprising tails" rather than "conforming tails." 

In our own data, a deviant case or "wild shot" always differs by 
at least four points from the next closest case, and in most in- 
stances the difference is five points or greater. Having omitted 
an occasional deviant case, or error, we then compute the mean of 
the remaining cases in the group, a procedure similar to what 
Tukey describes as "trimmed" mean. 

In each of the five graphs. Figures 1 to 5, it is obvious that 
the various types of institutions differ considerably from one 
another. On the Practicality scale (Figure 1) there is very little 
overlap between Teachers Colleges, State Colleges, and General 
Universities, on the one hand, and Selective Liberal Arts Colleges, 
Selective Universities, and Colleges of Engineering and Science, on 
the other hand. On the Community scale (Figure 2) the Strongly 
Denominational Colleges have very high scores, all but one of which 
is higher than the highest score of any Teachers College, General 
University, State College, or Selective University. On the 
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Table 22 

Percentile Equivalents for CUES Scale Scores 
Based on Reference Group of 100 Colleges and Universities 



Percentiles 

Scores Practicality Communi ty Aware ne s s Propriety Scholarship 



40 










100 


39 






100 




99 


38 




100 


99 




98 


37 




98 


98 




98 


36 




92 


96 




93 


35 




91 


94 




91 


34 




89 


94 




89 


33 


100 


88 


91 




86 


32 


97 


81 


88 


100 


81 


31 


95 


78 


88 


98 


77 


30 


93 


78 


85 


97 


77 


29 


91 


74 


81 


94 


73 


28 


91 


68 


80 


93 


69 


27 


86 


64 s 


76 


91 


66 


26 


84 


57 


76 


90 


59 


25 


81 


55 


73 


87 


52 


24 


78 


50 


70 


85 


50 


23 


74 


45 


65 


84 


46 


22 


69 


38 


64 


79 


43 


21 


62 


31 


62 


75 


41 


20 


57 


26 


55 


73 


33 


19 


49 


23 


50 


69 


31 


18 


44 


20 


47 


65 


27 


17 


41 


19 


45 


57 


25 


16 
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17 


39 


54 


18 


15 


28 


15 


31 


49 


15 


14 


26 


11 


26 


46 
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21 
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20 
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10 


12 


20 
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18 
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11 


13 
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18 


26 


6 


10 


16 


5 
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Range and Mean of CUES Scores for Different Types of 
Schools, with Most Deviant Cases Omitted: PRACTICAITTY SCALE 
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Range and Mean of CUES Scores for Different Types of 
Schools, with Most Deviant Cases Omitted: COMMUNITY SCALE 
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Number 

Included 9 19 9 10 19 9 10 7 100 

Mean 35.1 30.9 30.1 25.2 21.3 19.3 18.1 15.6 24.6 



Range and Mean of CUES Scores for Different Types of 
Schools, with Most Deviant Cases Omitted: AWARENESS SCALE 
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Included 10 10 19 9 19 9 9 9 100 



Figure 4 

Range and Mean of CUES Scores for Different Types of 
Schools, with Most Deviant Cases Omitted: PROPRIETY SCALE 
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Number 

Included 10 10 10 20 10 10 19 10 100 

Mean 26.6 19.6 18.7 17.2 15.3 14.2 13.0 9.7 16.55 



Range and Mean of CU^S Scores for Different Types of 
Schools, with Most Deviant Cases Omitted: SCHOLARSHIP Scale 
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Awareness scale (Figure 3) there is, except for a few deviant cases, 
no overlap in Selective Liberal Arts Colleges and Selective Univer- 
sities compared with Teachers Colleges, State Colleges, and 
Engineering and Science Colleges, On the Propriety scale (Figure 4) 
the Selective Universities have no overlap with any of the Teachers 
Colleges or Strongly Denominational Colleges, And on the Scholarship 
scale (Figure 5) almost all of the Selective Liberal Arts Colleges, 
Selective Universities, and Colleges of Engineering and Science 
have higher scores than any of the General Universities, State 
Colleges, or Teachers Colleges. 

The total number of deviant cases in our data is 25--eight on 
Practicality, eight on Community, six on Awareness, one on Propriety, 
and two on Scholarship — making five per cent overall. The fact thp 
this number is so small is, at least partially, a validation of 
the institutional classification we have developed, a classification 
which has resulted in very few mistakes or deviant cases. 

The total range of scores, and the adjusted range, in each of 
the eight types of institutions is shown in Table 23. In Table 24 
the adjusted range is shown as a per cent of the total range. 
Twenty-nine of the 40 percentages shown in this table are 50 per 
cent or smaller, indicating that the range within a subgroup is at 
least 50 per cent smaller than the range of the total group. 
Thirty-six of the 40 percentages are 60 per cent or smaller, in- 
dicating that in 90 per cent of the instances, the subgroup range 
is at least 40 per cent smaller than the total range. Table 24 
can also be read to reveal the ways in which colleges of a given 
type are most like one another. For example, Selective Liberal 
Arts Colleges are very similar with respect to Scholarship, Awareness, 
and Practicality, but they differ widely among themselves with res- 
pect to Propriety, Selective Universities are quite similar to one 
another on all scales except Propriety. Denominational Colleges are 
most similar to each other on the Community scale, and differ most 
on the Scholarship scale. General Liberal Arts Colleges run the 
gamut of scores on Propriety and nearly so on Scholarship; their 
similarity to one another is greatest on the Community scale. 

General Universities and State Colleges show a general reduction in 
range on all scales. Teachers Colleges differ most on the Scholar- 
ship scale; out are quite homogeneous on all other scales. From 
the average percentages in the right hand column, it is clear that 
General Liberal Arts Colleges are the most diverse set of institu- 
tions, and that Teachers Colleges are the most homogeneous. 

The typical profile for each of the eight major categories of 
institutions is shown in Figure 6. Since the raw scores on one 
Scale are not equivalent to the raw scores on other scales, the 
scores have been converted to percentiles. What is plotted on 
the graphs is the percentile equivalent of the "trimmed" mea:.r for 
each group. The differences between the institutional groups? are 
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Figure 6 

College Profiles 
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obvious in these typical profiles. Moreover, each group has a 
unique profile in at least one or more respects. Selective Liberal 
Arts Colleges are typically very high on the Scholarship and Aware* 
ness scales, considerably higher than average on the Community 
and Propriety scales, and very low on the Practicality scale. 
Selective Universities are similar to Selective Liberal Arts 
Colleges in having typically high scores on Scholarship and 
Awareness and low scores on Practicality. They differ sharply 
from Selective Liberal Arts Colleges with respect to Community 
and Propriety. General Universities and State Colleges differ 
from Selective Universities in having correspondingly lower scores 
on Scholarship and Awareness, and correspondingly higher scores 
on Propriety and Practicality. General Universities and State 
Colleges differ most from one another on the Awareness scale. 
General Liberal Arts Colleges and Strongly Denominational Colleges 
are generally similar in Scholarship, Awareness, and Practicality; 
they differ most in respect to the Propriety scale, and to a les- 
ser extent on the Community scale. The profile for Teachers 
Colleges is almost a mirror image of the profile for Selective 
Liberal Arts Colleges, Colleges of Engineering and Science are 
like Selective Universities in having a high score on Scholarship, 
but totally unlike Selective Universities in their low Awareness 
score. 



Validity Data 

The validity data consist of correlations between CUES scores 
and various characteristics of students and institutions. When 
all possible correlations are not shown in a table, the ones that 
are shown are only those which are significantly greater than 
chance at or beyond the .01 level of confidence. 

Table 25 relates CUES scores to various indicators of scholas- 
tic aptitude. For 49 of the 100 schools in the CUES norm group, 
data on the Scholastic Aptitude Test (SAT-Verbal) were obtainable 
from the College Board's Manual of Freshmen Test Profiles (6 ). 

For all 100 of the schools in the norm group, a freshman input 
factor labeled "intellectuality" by Astin ( 2 ) in his book Who 
Goes Where to College? was available for correlation. From the 
NORC survey of *61 graduates, the mean score on the National Merit 
Scholarship Qualifying Test (NMSQT) was available for 41 of the 
100 schools in the CUES norm group, and for a total of 70 schools 
altogether. In the NORC survey of *64 graduates, students were 
asked to indicate whether they had been in the top 10 per cent 
of their high school class. This information was available for 
63 schools in the CUES norm group, and for 105 schools altogether. 
On each of these indicators of college aptitude, and for each of 
the samples of schools, there is a significant positive correlation 
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Table 25 
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between students 1 academic ability and the college press scale 
for Scholarship. A similar positive relationship is true in most 
cases with the Awareness press; as are negative relationships 
with the Practicality press. 

In Astin*s study ( 2 ), noted above, there were six variables 
which he described as freshmen input factors. The correlations 
between those factors and CUES are shown in Table 26. Intellectuali- 
ty is defined mainly by SAT-Math scores and interests in science. 

This input factor correlates positively with Scholarship press, 
and negatively with Practicality and Propriety. Estheticism is 
defined mainly by having won awards in high school for art, music, 
and writing. It correlates positively with Awareness and Scholar- 
ship, and negatively with Practicality. Status is mainly a re- 
flection of the occupational and economic level of the student* 8 
family. The per cent of entering students from high status back- 
grounds is positively related to the college environment scales for 
Awareness and Scholarship, and negatively to Practicality and 
Propriety. Pragmatism refers mainly to the number of entering stu- 
dents who have Realistic vocational choices (such as Engineering) 
and to the proportion of men in the entering class. It is nega- 
tively related to Community, Propriety, and Awareness. Masculinity 
is defined mainly by the proportion of men in the student body 
and the proportion of students interested in Enterprising and 
Scientific occupations. Masculinity is negatively related to Com- 
munity and Propriety. 

Table 27 shows data for career plans, college major, and 
plans to attend graduate school. In general, the Practicality press 
is negatively related to career plans and college majors in science, 
social sciences, and humanities; but shows some positive relation 
to the fields of education and business. The Community press is 
negatively related to engineering, but occasionally has a positive 
relation to education and biological sciences. The Awareness press 
has positive relation to the fields of social science and humanities; 
and it has negative relationship with engineering and business. 
Propriety has clear positive correlation with the field of educa- 
tion; but negative relationship with engineering ana business. 
Scholarship is positively related to physical sciences and humani- 
ties, and to a lesser extent with biological sciences and social 
sciences; while its relation to education and business is negative. 

Between college press and students* recollection of their 
expectations as fsreshmen about going to graduate school there are 
relatively few significant correlations--£wo negative correlations 
each with Practicality and Propriety, and two positive correla- 
tions with Awareness. By the time of their senior year, however 
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Table 26 



Correlations between College Press and 
Freshman Input Factors Developed by As tin 



Practicality Community Awareness Propr iety Scholarship 



Inte llectuality 


-.62 


-.18 


.28 


-.33 


.60 


Estheticism 


-.45 


.07 


.36 


.18 


.27 


Status 


-.38 


.16 


.53 


-.28 


.25 


Pragmatism 


.14 


-.52 


-.29 


-.45 


.07 


Masculinity 


-.02 


-.28 


-.12 


-.57 


.12 



N « 100 

(Note; Underlined coefficients are significant at p. 01) 
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Table 27 
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there are many more significant correlations--four negative cor- 
relations with the Practicality press, three negative correlations 
with the Propriety press, two negative correlations Wxtn the 
Community press, and three positive correlations with the Scholar- 
ship press. 

A variety of student attitudes and activities are associated 
with college press, as shown in Table 28. The proportion of 
students regarding themselves as unconventional is positively re- 
lated to Scholarship press, and negatively related to Practicality, 
Community and Propriety. The proportion of students who regard 
themselves as religious is positively related to Practicality, 
Community and Propriety. Attending church regularly is also 
positively related to the Community and Propriety press scales. 
S“udents reporting that they have no religious preference are 
found, in greater proportions, in environments characterized by 
high press for Awareness and Scholarship. 

The proportion of students reporting that they have had some 
experience in carrying out a research project is positively related 
to Scholarship pxess and negatively related to Practicality press. 
Participation in no extra-curricular activities is a rare phenom- 
enon in environments having a high Community press. Active par- 
ticipation in civil right is positively correlated with Scholar- 
ship and Awareness, and also in one instance with Community, but 
negatively correlated with the Practicality press. 

The per cent of students who regard the understanding and 
appreciation of ideas as the most important objective of college 
education--either for themselves or for the typical student at 
their college--is positively related to the Scholarship, Aware- 
ness, and Community scales, and negatively related to the Prac- 
ticality scale. 

The proportion ox students who say that they feel a strong 
emotional attachment to their college is positively related to 
the Awareness and Community aspects of the environment, and to a 
lesser degree to the Propriety aspect. It is unrelated to either 
Practicality or Scholarship. 

In the 1961 NORC survey, students were asked to rate their 
college with respect to the excellence of classroom teaching, 
the excellence of facilities for research, the excellence of 
the student body, and the excellence and distinction of the faculty. 
The correlations between these qualities and college press are 
shown in Table 29. The proportion of students rating all of these 
qualities as excellent at their school is positively related to 
the Awareness and Scholarship press scores of their school, and 
negatively with the Practicality press scores. The research 
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Table 28 
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quality of the school is also negatively related to the Community 
and Propriety press scores. 

The Environmental Assessment Technique, or EAT, developed by 
Astin and Holland (4 ), was subsequently, with some modification, 
applied to all accredited colleges by Astin (2 ) ' in his book Who 
Goes Where to College? with standard scores assigned to each of 
the EAT variables. Correlations between these and the variables 
measured by CUES are shown in Table 30. Practicality press is nega- 
tively related to Selectivity and to Scientific orientation, and 
positively related to Conventional orientation. Community press is 
negatively related to size and Realistic orientation, and positively 
related to Social orientation. The Awareness press is positively 
related to selectivity, Enterprising orientation, and Artistic ori- 
entation. Propriety relates negatively to selectivity, size, and 
Realistic orientation, and positively to Conventional and Artistic 
orientations. Scholarship is positively related to selectivity, 
and Scientific orientation, and negatively related to Social orien- 
tation. These EAT variables are defined as follows: (1) Selectivity 

is the number of able students who apply for admission divid d by 
the number of freshmen admitted; (2) Size is total full tin. en- 
rollment; (3) Realistic orientation is the per cent of degrees 
given in such fields as engineering, agriculture, physical educa- 
tion (4) Scientific orientation is the per cent of degrees given in 
various natural science fields; (5)Social orientation is the per 
cent of degrees in education, nursing, social work, etc.; ( 6 ) Conven- 
tional orientation is the per cent of degrees in accounting, business, 
economics, library science, etc,; (7) Enterprising orientation is the 
per cent of degrees in advertising, business administration, history, 
political science, journalism, etc; and ( 8 ) Artistic orientation is 
the per cent of degrees in fine arts, writing, languages, music, 
speech. 

Most of the institutional statistics whose correlations with 
college press scores are shown in Table 31 are in one way or another 
reflections of institutional size: size of student body, size of 

staff in various categories, size of financial resources, size of 
library, and complexity of the institution. All of these institu- 
tional factors have negative correlations with the Community, and 
Propriety press scores. Most of them also have positive correlation 
with Awareness, and, to a lesser extent, with Scholarship. Two 
items in the table are not functions of size. One is the per cent 
of faculty members with PhDs; but this also has negative correla- 
tions with Community and Propriety, although not positive correla- 
tions with either Scholarship or Awareness. The other item is 
tuition; and here the correlations are negative with Practicality, 
and in some cases positive with Scholarship. 

Table 32 shows all the correlations between the college press 
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Table 30 



CM 



w 






IN 


f-41 


ml 


o 


00 


VO 


M 


m| 


H 


rH 


<t\ 


co| 


CM 


o 


o 


<0 



















o 

o 

CO 



XJ 

01 

•H 

a 

o 



si 



1 




CO) 


o>) 






1 H 


rH 




cm| 


CM 


cm| 



(0 




(U 




rH 


CO 


Xi 


CO 


CO 


cu 


*H 


a 




cu 


CO 


H 


> 


3 

3 


<1 

W 


< 


>i 




XJ 


c 


•rH 


CO 


d 




=5 


to 


£3 


CO 


B 


0) 


o 


M 


o 


P* 




Q> 

00 


u 


cu 


•H 


rH 


rH 


rH 


«0 


o 


O 


o 


*H 




XJ 


c 


O 


0> 


CO 


CU 




3 




XJ 




01 




X> 




CO 




c 




o 




•H 




4J 




CO 




rH 




fl J 




u 




u 




o 




u 





| m 


CO 


00 


ON 


CO 


M 


rHl 


l| rH 


CM 


o 


o 


o 


col 


<n 





o>| 


°1 


00 


ml 


cn 


co 


<1- 




rH 


vd| 




o 


cm| 


rH 


rH 


CM 




















O 


1 


1 


s 






1 






O 



>1 




CM 


o\\ 


<!■ 


CM) 


rH 




CM 


rH 


cm| 


CM 


co| 


rH i-H 



a 

o 



c 

o 







C 


o 




XJ 


XJ 








o 


*iH 




co 


cO 


s 






•H 


X> 




XJ 


XJ 


o 






XJ 


CO 


d 


c 


C 








to 


XJ 


o 


Of 


0) 


XJ 






XJ 


c 


•H 


•H 


•H 


CO 






c 


01 


XJ 


u 


U 


XJ 






cu 


•H 


CO 


o 


o 


C 






•H 


U 


XI 






0) 






M 


O 


d 


rH 


60 


*H 






O 




0) 


2 


d 


M 


4J 






a 




d 


*H 


O 






a 




M 


o 


CO 




> 




•H 


MH 


O 


•H 


iH 


O 


*t*4 




XJ 


*H 




XJ 


M 


*H 


4J 




CO 


JJ 


rH 


d 


CU 


XJ 


O 




'H 


c 


CO 


Of 


M 


to 


CU 


0) 


rH 


CU 


tH 


& 


CU 


•H 


H 


N 


<0 




o 


d 


XJ 


XJ 


01 


*H 


as 


O 


o 


o 


d 


M 


CO 


CO 


txj 


CO 


CO 


o 


w 


< 



O 

ERIC 



68 



(Note: Underlined coefficients are significant at p. .01) 



m 

CM 



cn 



CM 



cd 

EH 



42 

03 VO 

U - 



o - 

w 



CO 

a 

*H 



cd 

a 

o 



T) 

a 

cd 



<u 

u 

a 

<u 

00 

03 



O 

O 

c 

03 

§ 

4J 

<u 

43 

CO 

a 

o 



03 

W 

O 

O 



u-o- 

a) vo 

- 

a 

o 

M vO 

a - 



CO 

CO <t 
0) vD 

c - 
0) 

M 

cd <-« 
£ so 

< - 



it <t 

•M SO 

f— l i 

cd 

o 

JJ rH 

a vo 
cd - 
u 
a 







m 






*H 








CO 






CO 






00 


o 






m 




CM 


co 




CO 


CM 


CO 




<1- 




1 


i 


* 


i 




1 


(X) 


uo 


VO 




sO 




m 


cn 


<fr 


CO 




CO 




m- 


i 


1 


l 




9 




i 


00 




CM 




CO 




CM 




<fr 




CO 


CO 




<T 


i 


1 


1 


1 


1 




1 


vO 


CO 


CO 








On 


<r 


<r 


<r 








CO 


a 


i 


a 








3 


H 


t*H 


rH 




CO 






cn 




<fr 










r-t 


CM 


o 










CO 


<r 






<* 


CM 






sO 


CO 




CM 








CO 


CO 




CO 






r— 1 


<* 


SO 


m 


O 


sO 


(X> 


vO 


in 


<E 




*n 


CO 


CM 


1 


i 


1 


i 


i 


1 


1 


1 CO 


vO 


00 


CO 


CO 


o 


CO 


1 vo 


m 






m 


CO 


CO 


| « _ 


i 


9 


1 


i 


i 


1 


vO 


H 


r* 


r> 


o 


Mi- 


ON 


vO 


m 




<1- 




ni- 


co 




i 


i 


i 


i 


i 


i 


ON 




CO 


CM 








to 




* -d* 










I 


i 


i 


1 











m 

m 

r 



03 


i 












1 








03 








42 


1 




o 


3 










03 


o 








03 


i 






a 


o 




*ri 


TJ 




oj 


>. 


1 


> 


<d 


1 




M 


U 


43 




M 


M 


td 




4 -> 


cd 




a 


4 -> 


3 


O 


44 


w 




O 








O 


cd 


44 




CO 


U| 




•iH 


f -4 




A 




♦H 




44 


> 


r 4 




44 


03 








00 . T 3 


44 


9 




cd 


u 


CO 






H 




co 


44 


CO 


44 


2 


U 


u 


<u 




O 


44 




o 


CO 




44 


03 


44 


03 


03 


O 


cd 


03 


r 4 


rH 


cd 


O 


u 


•H 


Cd 


ft 


44 


03 


44 


o 


44 


}H 




a 


u 


TJ 


rH 


rH 


44 




o 


s 




O 


cd 




cd 




cd 




03 




Vi 


a 


o 


9 




4 ^ 




3 


43 


JJ 


44 


rH 


44 


> 


4 J 


T 5 


00 42 


3 


M 


44 


44 


3 


M 


f-i 


Cd 


03 


<0 


0 ) 


(0 


U 


CO 


03 


Cd 


jj 


rH 




S 




a 


cd 


o 




r 4 






c 




03 




N 


4 J 


*i 4 


0 ) 


44 


03 


4 H 


03 


M 


u 


44 


1 


A 


44 


a 


44 


03 


44 


»H 


c 


Ss 


cs 


o 


o 


T 3 




o 


O 


r 


0 ) 


O 


o 


O 




o 


a 


03 




cs 




ce 




*H 


42 


3 




to 


JJ 




03 




ts 




cd 


o 




o 


• 


03 


ft 


CO 


4 J 


M 


ft 


44 


C 


ft 


M 


ft 


M 


ft 


00 


u 


44 


10 


o 


■u 


o 


03 


*H 


44 


o 


rH 


cd 


o 


03 


o 


cd 


o 




0 ) 


r 4 


u 

<u 

a 


a 


<d 


55 


M 


3 


00 


55 


3 


4 J 


55 


a 


55 




a 


O 


a 


3 



o 

ERIC 



Table 31 (Continued) 



u 

CL 

o 

u 



W 

<0 



<U 

13 









r^. 






<3- 


m 










CM 






CO 


co 






1^ 








CO 




00 






CO 




CO 




CO 


CO 


CO 






















sO 

IV 






sO 


<3- 






co 






CO 




CO 


co 






co 




i— 4 


















vO 




















f^. 


U0 


O 






OS 


CO 


so 




CM 


CO 


<3- 






CO 


CO 


<3- 




1 


* 


1 






1 


1 


1 


<3- 




in 


fH 




OS 


r— 4 


CM 


O 


SO 




CO 


<3- 




CO 


<3- 


CO 


<3- 






i 


1 




1 


I 


t 


1 






sO 


CO 


m 






CO 


oo 


r— 4 




Mfr 


<r 


CO 








<3- 


sO 




1 


• 


3 






f 


1 






sO 


sO 






<3- 




sO 






<t 


<T 






in 




in 






(M 


CO 






i—4 


so 








<r 


CO 






m 


<3* 








<M 


so 




uo 


<3- 


m 




sO 






CO 




<3- 


m 


<3- 




M 
























O0 






Os 


Os 




r-4 




<3- 


CO 






CO 


<r 




sO 








































co 










<3* 








<3- 








in 




















m 








<3* 


SO 




o 


m 




m 






<3- 


CO 




CO 


<3- 




i 






t 


1 




1 


1 




















Os 


sO 


<3- 




sO 


CM 




CM 


00 


<3* 


<3- 


sO 




<3" 


CO 




m 


<3- 




1 


— 




i 


1 




1 


i 




















sO 


r-4 






in 


so 








CO 


S0 


i— 4 




CO 


co 








1 


t 


SO 




i 


i 












— 
















CM 


















r*^ 




CM 


















in 


















r^. 
















sO 


in 


















r-i 




m 


CM 












SO 




CO 


<h 












i 




1 












i— 4 


r-4 
















sO 


MO 
















“ 


1 









































i 

•H 


a> 








G 


u 




JJ 












•S 


co 






o 


L 




G 










(0 


JJ 


to 


O 






*H 


G r-4 




<y 










H 


CO 


G 








JJ 


3 O 




i 










cd 


d 


u 


JJ 








rd 














o 


•H 


rd 


w 




G 


CO 


g a 




o 


JJ 




to 


CO 


•H 




Q> 






O 


•r4 


O CO 






c 




o 


a> 


no 




U 


JJ 






3 






c 


a> 




•H 


i 


O 


O 


CL 


*0 




JJ 


V* 


•u a 




a* 


M 




4J 


3 


•H 




s 


4J 




G 


O 


G U 






u 




CO 


i-4 


1-1 to 


Pi 


o 


to 




3> 


ttf 


a) cd 




V4 


3 




*H 


0 M 


<U M 


JJ 


o 






CL 




CL 3 




o 


O 




JJ 


cd 


CL CQ 


•i-l 


1 


i— 4 


e 


<0 


>s 


co 03 




M-l 


1 




cd 


u 


l-l 


X 


1 


ctf 


o 




U 








1 


Oj 


jj 


CM ,JQ 


U-4 ,JQ 


0) 


c* 


•H 


•H 


to *d 


>s 1-1 


co 


to 


to 


B 


CO 


0 *H 


O *H 


f—4 


o 


O 


■U 


0) 


U 


ai oo 


cl 


Q> 


0) 


o 




r-« 


f—4 


CL 


•H 


c 




G J3 


a u 


•rl 


C 


c 


o 


u 


* 


* 


a 


-U 


0 


3 


o 


*<-l 


O OJ rC 


O 


o 


G 


0) 


o a 


o d 


o 


3 


d 

*ri 


H 






CO 


E 


£ 


't 


a -h 


a n-i 


a 


JJ 


P 4 


















o 











o 

ERIC 



Table 32 



Correlations between College Press and the 
Institutional "Factors" Developed by Astin 

Practicality Community Awareness Propriet y Scholarship 



Affluence 


-.65 


-.03 


.46 


-.38 


.65 


Size 


.22 


-.65 ' 


-.01 


-.27 


-.08 


Masculinity 


.15 


-.26 


-.24 


-.30 


-.02 


Homogeneity 


-.32 


.16 


-.25 


.28 


.14 


Technical 












Emphasis 


.23 


- .40 


-.38 


-.13 


-.13 



N ■ 61 

(Note: Underlined coefficients are significant at p. .01) 
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scales and the factors developed by As tin from analyzing an 
assortment of institutional characteristics. As tin’s data are 
reported as rankings of some 300 or so institutions on each of the 
factor scores. For the 61 schools in Astin's sample for which we 
had CUES scores, we ranked their factor scores from 1 to 61, then 
reversed the signs of the resulting correlations so that, for 
example, a positive correlation between Affluence and Scholarship 
means that high affluence and high scholarship go together. In 
the table, the significant correlations are identified. Practicality 
is negatively related to Affluence and Homogeneity. Community 
is negatively related to Size and Technical Emphasis. Awareness 
is positively relrted to Affluence and negatively to Technical 
Emphasis. Propriety is negatively related to Affluence and Mascu- 
linity. And Scholarship is positively related to Affluence* Astin’s 
institutional factors are derived from many pieces of information, 
but the essence of each factor may be described as f o Hows :(]) Affluence 
is a combination of intellectual and financial resources--bright 
students plus money produce a high score on this factor; (2) Size 
is simply the total student enrollment; (3) Masculinity is the per 
cent of men in the student body; (4) Homogeneity refers to the cur~ 
riculum, that is, to the number of different fields in which degrees 
are offered and the extent to which students are concentrated in a 
few 1 programs or spread over many different programs; and (5) Techni- 
cal Emphasis refers to Engineering and similar technical specialities 
and reflects the degree to which this emphasis constitutes a large 
or small part of the total institution. 



By-Products and Other Data 



One of the side-projects of the present study involved trying 
out a new set of items for possible inclusion in a revised edition 
of CUES. The project was one of several supported primarily by a 
grant from the College Entrance Examination Board. Its main pur- 
pose was to develop items which might contribute eventually to 
the publication of a special diagnostic edition of CUES for measur- 
ing the environmental press of different subcultures in complex 
universities. At tho same time, the try-out of these new items 
would provide a resource to draw upon for modification of the regu- 
lar edition of CUES if such modification seemed warranted. Since 
the results of this project have been fully reported elsewhere (2l)» 
they are not included in the present report. Briefly, however, a 
300 item test (150 from CUES plus 150 new items) was administered 
to students in various academic fields at four universities. From 
the data received (710 responses from 15 academic groups in four 
institutions) the difficulty and discriminating power of the new 
items was estimated. When the revised edition of CUES is pub- 
lished by Educational Testing Service, the test will consist of 
the five 20-item scales we have described in the present report, 
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together with the normative data on these scales, plus an additional 
ten items tentatively assigned to each of the scales. The ten new 
items for each scale have been selected from the 300 item test des- 
cribed above. The inclusion of these items, and similar ones in 
future editions, will provide the basis for continued renewal and 
revision of CUES. The items retained from the current edition of 
CUES, plus the new items, are shown in the Appendix. 

Three other side-projects, also supported primarily by a grant 
from the College Entrance Examination Board, were in part facili- 
tated by data from the present national study of college environ- 
ments. The 300-item test noted above was used by Dr. Vernon Hendrix 
to collect national normative data on junior college environments. 

A preliminary report of this and related junior college studies has 
been made (20). Another study has analyzed the extent to which dif- 
ferent groups of reporters describe the campus in similar ways (18) • 
It was found, for example, that CUES scores are highly stable when 
based on comparable samples of students over a one or two year 
period; that women tend to perceive the environment as slightly 
higher in Community and Propriety than men do; that faculty and 
student perceptions are very similar except on the Scholarship scale, 
where faculty responses result in a higher score; that sophomores, 
juniors, and seniors produce very similar scores, but that the per- 
ceptions of freshmen are quite different; that there are no major 
differences in the scores related to whether the students are aca- 
demically successful or unsuccessful, or are residents or commuters; 
that there are no differences, except in the Scholarship scale, re- 
lated to the student 1 s major academic field; and that perception 
of the environment is unrelated to any personality characteristics 
of the students. Overall, the report concluded that CUES scores 
obtained from different groups on the same campus were highly con- 
sistent and reliable. Differences in scores rarely exceeded three 
points on the 30-itera CUES scales. Finally, a special report was 
written for the College Board on the possible uses of CUES in the 
admissions process (19). Expectations of high school seniors and 
entering freshmen at various colleges as to what they thought 
would be true about the college environment were compared with 
campus profiles obtained from upperclassmen. Large discrepancies 
were apparent. By using information obtained in the national study 
of college environments, guidelines can be presented to prospective 
students indicating how likely certain features or conditions will 
be found at different types of institutions. 
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DISCUSSION 



The kind of research involved in the present study may ap- 
pear to be quite simple and uncomplicated- -common item discrimina- 
tion indexes, routine factor analyses, percentiles, correlations, 
and a few graphs. But underlying the straightforward application 
of familiar techniques at. problems, issues, and judgments which 
call for broad perspectives about higher education and about the 
nature of measurement. A discussion of these problems follows; 



National Baseline or National Sample? 

The goodness of psychometric data about any test, and the 
fairness of interpretations that can be made of the test results, 
depend upon the adequacy of sources used in making the analyses 
and the interpretation. It is for this reason thet a good deal 
of thought was given to the problem of what constitutes an adequate 
data base for the analysis and interpretation of a test whose 
purpose is to measure, reliably and meaningfully, major ways in 
x*hich the perceived characteristics of college environments differ 
from one another. 

The common and respectable approach of drawing a random sample 
from some defined universe is deceptively simple. One could take 
every nth insitution listed in the American Council on Education's 
directory of American colleges and universities, but what would 
he get? The resulting sample would consist primarily of a lot of 
small colleges, since there are many more small colleges than large 
ones; but these small colleges are not the environments where most 
college students live. Most college students are in large complex 
universities. It does not help matters merely to obtain a larger 
number of student reporters from the large campuses than from the 
small campuses. The unit of study is the number of institutions, 
not the number of students, beyond whatever number of subjects are 
needed to give stability to the results, adding more subjects is 
3imply redundant. The problem, really, is to define appropriately 
the universe from which a sample is to be drawn. In the initial de 
ve lopment of CUES, the universe was a national distribution of 
college enrollments. Thus, If half of all the college students in 
the country are in large complex universities, then half of the 
institutions for a national sample of environments should be en- 
vironments of this kind. While this approach provides a more equit 
able sample of environments than the other approach, it is still 
not very satisfactory for a variety of reasons. Both approaches 
result in having a lot of institutions which are more or less alike 
either big universities or small colleges as the case may be--and 
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thus reduce and obscure differences between institutions on a 
national scale. Various categories of institutions may be properly 
represented according to their numbers or their enrollments, but 
not necessarily according to their significance or importance in 
American higher education. This is an educational and social judg~ 
ment, not a statistical judgment. For example, neither the number 
of institutions, nor the enrollments in them, of colleges of 
Engineering and Science is very large, but the importance, leader- 
ship, and status in society and education of such places as MIT, 

Cal Tech, Carnegie Tech, etc., i9 far greater than mere numbers. 
Predominantly denominational colleges, both Protestant and Catholic, 
are similarly important in American education, both historically 
and as examples of significant -values , regardless of numbers. 

We did not deliberately set out to obtain a sample of college 
environments in the pure probability definition of the term sample. 

We did obtain, however, CUES scores from a great variety of insti- 
tutions across the country. From this variety we selected ones 
which we be lievedwould represent both the diversity of American 
education and the importance of various segments of American educa- 
tion. The result is not a national sample; it is a national base- 
line. It is composed of major categories of institutions, with 
representative examples in each category. This approach is analo- 
gous to the Dow-Jones average for the stock market- -which consists 
of rationally chosen categories of investment important to the economy, 
such as rails, utilities, industrials, etc., with selected examples 
in each category. Thus, in our own studies of college environments, 
we decided, from previous research and personal judgment about 
higher education in the United States, that there were important 
and distinguishable categories of colleges and universities which 
should be included in a national baseline, and we selected ex- 
amples in these categories. For educational and social reasons we 
regard the concept of a national baseline or reference group as 
preferable to the concept of a sample. 



What Is Characteristic of an Environment? 



This question goes to the heart of the rationale for scoring 
and interpreting CUES. The answer requires one to distinguish 
clearly between the opinion polling or collective perception ra- 
tionale of CUES and the more familiar individual differences ra- 
tionale of educational and psychological testing; and to understand 
that what is being measured by CUES is the environment not the 
students. Some researchers who have used CUES, perhaps because 
they are uncomfortable without such familiar artifacts of the 
psychometric profession as means, sigmas, and t-tests, have proceeded 
to "score" CUES as they would score most other tests— name ly , to 
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count the number of items each person answers correctly, to make 
a distribution of their individual answers, to compute a mean of this 
distribution as a measure of the environmental press of the school, 
and to use the sigma of the distribution in estimating the reliabili- 
ty of the score* The results onf» gets from this manner of using 
CUES are not comparable to the results one gets from using CUES as 
it was meant to be used* If, to each of the 20 items in a scale, 
half of the students answered "true 11 and half answered "false," 
the mean score would be 10. But, following the rationale of CUES, 
the institutional score would be zero, because there is no real 
consensus nor any dominant collective perception about any of the 
items* In our use of the word "characteristic?! we mean "dominant," 
not "average." We mean something that stands out, that is widely 
shared or seen or felt* A 50-50 split simply means that the con- 
dition or eventor behavior is not characteristic, is not collectively 
perceived with any high degree of consensus * 

The unit for scoring CUES is the item, not the individual* 

Does this item describe a condition or event or practice which is 
characteristic of the institution in the sense that the vast ma- 
jority of reporters who live in the environment recognize it as 
true about the environment? If it does, then it is a potential 
stimulus for some sort of adaptive response* The number of such 
characteristics, or potential stimuli, all falling along a single 
dimension such as Scholarship, indicates the degree to which the 
institution exerts a "press" or stimulus in the direction of 
Scholarships The result is a count of dominant collective per- 
ceptions, not an average of individual perceptions, an institu- 
tional score that is quite different in meaning and in educational 
significance from an average of individual scores* 

We have retained, and extended, this rationale in the revised 
edition of CUES, 



What Is a Reliable Score? 



Since a CUES score is not an average of individual scores, 
it is not possible to estimate its reliability in the typical man- 
ner used with most educational tests* But one can plot a distri- 
bution of CUES scores for 100 institutions, as we have done, com- 
pute the variance of this distribution, and arrive at a K-R relia- 
bility estimate* This is the reliability with which the test 
discriminates between institutions* 

The reliability of the score of a single institution is a 
function of two conditions: (1) the size of the s maple on which 

it is based, and (2) the number of items falling close to the 66/33 
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borderline of being counted or not counted in the score. Bas- 
ically, then, the stability or confidence that can be attached to 
a single score depends on how many items come close to being 
counted or not counted. From inspecting item percentages for hun- 
dreds of schools, we know that it is very rare to find a situation 
where there are four or five items with percentages just above 
66 but none just below 66, or vice versa. Unless one finds this 
sort of imbalance, the score is likely to be stable. Moreover, 
scores obtained from different groups of reporters at the same 
institution are very similar, rarely differing by more than three 
or four points on the 30-item scales in the published edition of 
CUES. Furthermore, the meaning of scores is very stable over time. 
When scores obtained from comparable samples of students at the 
same institution, separated in time by one or two years, have 
been compared we have rarely found differences greater than two or 
three points; and, whichever score is higher, the higher score has 
consisted of the same items that accounted for the lower score, 
p lus one or more new items. 

If one tries to compute the reliability of individual scores, 
one gets a very peculiar result, and for good reason. The only 
way to get high reliability, by the usual methods which depend on 
the variance of scores, is to have a high variance. Thus, by this 
procedure at a single institution, a high so-called reliability 
means simply that there is little consensus; but a low so-called 
reliability may mean that there is a great deal of consensus. 
Within an institution it is precisely the existence of consensus 
which makes a CUES score truely reliable, and therefore makes re- 
liability estimates based on variance totally inappropriate and 
erroneous. 



Similarity and Diversity in College Environments 

The magnitude of differences between college environments is 
impressive. The fact that large differences exist is unassailable, 
but many who write about higher education appear to ignore it or 
to mention it in passing without understanding it. One cannot 
describe or rank colleges along some single dimens ion--such as 
intellectuality or scholarship--if one really understands the 
diversity and complexity of higher education in the United States. 
Not one dimension but many dimensions are required if one is to do 
justice to the facts. Moreover, the fact that many dimensions are 
needed means that many combinations will be found. Schools that 
are quite similar in several respects may be quite different in 
✓ another . 

CUES certainly does not measure all the important ways that 
college environments differ from one another, nor does it measure 
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the many ways that sub^f rvironments within a single campus differ 
from one another. CUES does, however, give national perspective to 
the study of college environments along five broad dimensions, all 
of which have obvious relevance and validity for the understanding 
of higher education. For the individual college it also provider 
self-knowledge about 150 specific aspects of the local environment . 

For the researcher it enables the differential effects of college 
education to be related to different characteristics of the college 
environment. Using an instrument similar to CUES, the present’ writer 
(17) demonstrated that students 1 attainment of various objectives 
was definitely related to relevant aspects of environmental press, 
and also that these relationships were much stronger between colleges 
than between subgroups within a given college. Across a national 
assortment of colleges, the differences between institutional en- 
vironments are much greater than the differences between various 
subenvironments within a particular college. 

Since the choice of a college does make a difference in what 
happens to the student, it is important for students to know what 
they are choosing, if they have a choice. Unfortunately, the im- 
pressions which high school seniors have about what college is 
like add up to a national stereotype undifferentiated with respect 
to specific colleges. Even entering freshmen, having already ar- 
rived on the campus, have a pattern of expectations which is generally 
similar, regardless of the college they have been admitted to. 

High Scholarship, high Awareness, and high Community are common 
expectationy-whether it is a junior college, a State college, a 
private university, or a liberal arts college. The national data 
now available from CUES can be used to give high school students, 
their parents, and their counselors much better information about 
what college is really like. A method for providing this informa- 
tion has been recommended to the College Entrance Examination 
Board. 

Although the national picture of college environments reveals 
great diversity, the classification of colleges into the eight 
types which have been developed and confirmed in the present study, 
offers practical guidelines in the choice of a particular type 
of college. There is some unity within the national diversity. 

Except for the General Liberal Arts colleges, the range of scores 
within a type is less than half as great as the range of scores in 
the total national group of 100 colleges. Within many of the types, 
and on several of the scales, the range is only one-third the size 
of the total range. Given this narrower range, the prospective 
student knows, with reasonable helpfulness, what to expect. The 
information can, in fact, be presented to him by specific CUES 
items. For example, the probability that it will be important 
socially to belong to the right club or group is 60 per cent at 
General Universities, but only 14 per cent at highly Selective 
Liberal Arts colleges. The opportunity to make this kind of 
information available is now possible because of the present study , 
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Some Comments on the "Image" Approach to Measurement 



There have been several criticisms of the "image 11 approach 
to characterizing college environments. It is said that what 
students think is true may not really be true, that this percep- 
tion lay simply reflect a stereotype or halo. It is said that the 
truth or falsity of many items in CUES can not be verified by in- 
dependent observation. And it is said that perception is not 
really a stimulus and thus may not have much impact on students 1 
behavior. None of these criticisms have any real substance, but 
we shall comment briefly on them# 

People who have a widely shared experience, and report its 
nature with a high degree of consistency, are reporting the truth 
as they have seen it, not a fantasy. High agreement does not con- 
stitute a stereotype or halo. The only halo obtained from CUES 
comes from high school seniors and entering freshmen who have not 
yet experienced the college environment they are trying to des- 
cribe. After they have been in the environment for a year or 
more, the halo no longer exists. There is no evidence that the 
ethos of a campus is imaginary# 

Not all judgments or opinions can be verified by independent 
observation, but this does not make them invalid# If the mayor 
says that New York is a "fun city," we may question his judgment; 
but if all the people who live in New York say it is a *fun city," 
who is left to day they are wrong? The total universe of people. 
New Yorkers, provides the ultimate validation. The collective 
judgment is the fact# Some judgment-type items can be checked 
against other information. The statement that "in many classes 
students have assigned seats" can be checked. We know that schools 
where students agree, two to one or better, that this statement is 
true do in fact have some classes where students have assigned 
seats. We don't know how many is "many." If we actually counted 
the numbers, all we would have would be a definition of "many." 

We surely would not find an instance where there were none. Re- 
gardless of whether "many" turned out to be one-third or one' fifth, 
it is still perceived as "many" and the feeling expressed is still 
valid in its own right. One cannot argue seriously that one in- 
dicator is right and another is wrong. In the early history of 
attitude measurement some researchers, including the present writer, 
felt that "behavior" should be regarded as the ultimate criterion# 
But we came to realize that asking different questions produced dif- 
ferent answers, each with Its own validity# If attitudes and ac- 
tions do not correlate highly with each other, one might say that 
attitudes are not very predictive of actions or that actions do 
not provide a good basis for inferring attitudes. 

The question of whether the perceived environment has an im- 
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pact on students' attainment of relevant objectives has been an- 
swered in previous research. It does. Therefore, the perceived 
environment, in fact, constitutes a stimulus or treatment which 
makes some outcomes more likely than others. The intensity or 
strength of the stimulus is defined, for the institution, by the 
number of stimuli (items in a particular scale) that are charac- 
teristic of the college. 

The correlational data described in the previous section-- 
relating CUES to various characteristics of students, students' 
behavior and attitudes, and to other aspects of college environ- 
ment— are all complementary in the sense that relationships which 
one would expect to find are found. None of the approaches to 
describing college environments has produced results that are 
contrary or opposite to results produced by other approaches. Thus, 
all approaches benefit from this network of interrelationships. 

Each approach provides information along soii^ different dimensions, 
and some overlapping dimensions. In so far as the broad dimen- 
sions are similar, the results, regardless of the method, are also 
broadly congruent. With correlations the size that have been re- 
ported, it is fair to say that relevant characteristics of the 
student body, the frequency of relevant student behavior, rele- 
vant variables from the EAT, and other relevant institutional char- 
acteristics, can v all be predicted from the environmental press 
measured by CUES with about the same degree of accuracy as college 
grades can be predicted from SAT scores— i.c . 9 in the general range 
from the low .30s to the high .60s. 
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CONCLUSIONS 



Prerequisite to any thoiotgh and appropriate study of the 
psychometric properties of a nationally used test (properties such 
as item discrimination, item and scale intercorrelations, factorial 
structure, reliability, construct and concurrent validity, etc.) is 
the development of a nationally representative set of data upon 
which to base the analyses. The national data base for the present 
study has been described and discussed. The conclusions from analy 
zing the data are presented under four headings; (i) Psychometric 
properties of the current edition of CUES; (2) Psychometric prop- 
erties of the proposed revised edition of CUES; (3) Institutional 
differences and norms; and (4) Validity and other interpretative 
information. 



Psyc^ imetric Properties of the Current Edition of CUES 

1. The distribution of scores from the national reference 
group of 100 colleges and universities showed a tendency, on some 
scales, to bunch toward the lower end of the scale, thereby re- 
ducing the potential discriminating power of the tost. 

2. By using a different scoring procedure--one which takes 
into account all items about which there is a two to one consensus 
rather than only those which achieve this level of consensus in 
the "keyed" direction-- the resulting distributions are more symetri 
cal and the scores do not pile up at the lower end. This scoring 
procedure is called the 66/33 method, to distinguish it from the 
66+ method described in the current test manual. 

3. Analyses of item characteristics in relation to scores 
computed by each of the above methods show that the 66/33 method 
is better in the following respects: 

a. more items correlate .40 or higher with the scale 
score; 

b. more items have their highest correlation with the 
score in the scale in which they are located; 

c. the median correlation of item:* with their ovm scale 
is higher; 

d. the median correlation of items in a scale with the 
items in other scales is lower, indicating greater 
independence between the scales. 

4. Factor analyses of the 150 item test, divided into equiva- 
lent thirds for this purpose, produced no significant or interpret 
table factors other than the same five basic factors which led to 
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the present structure of the test in the first place. 

5. However, both the factor analysis data, and the item 
discrimination data, showed that there were some items which, if 
removed, would definitely improve the test. 

6. It was decided to improve the test by retaining what 
seemed to be the best items, reducing its length from five 30-item 
scales to five 20~item scales, and to use the 66/33 method of scor- 
ing instead of the 66+ method of scoring. 



Psychometric Properties of the Revised CUES Scales 



1. The mean percentages giving the keyed responses (across 
the sample of 100 institutions) to the retained items all fall 
between 10 per cent and 90 per cent, with all except five items 
falling between 20 per cent and 80 per cent. Thus, all items are 
reasonably "functional 11 with respect to item difficulty. Similarly, 
the standard deviations of the distribution of percentages are, 

all except three, greater than ten points, with 75 having sigmas 
greater than 15 points. 

2. All correlations between an item and its own scale score 
are .40 or higher. 

3. The median correlation of items with their own scale score 
is higher, for each scale, than previously; and the median cor- 
relation of items between scales is, in most cases, lower than 
previously. 

4. The inter correlation of scale scores is lower, in most 
cases, than previously. 

5. The factor structure is quite clearly defined. Eighty- 
six per cent of the items have their highest factor loading where 
they should have them. Although the Practicality scale is fac- 
torially the weakest, all items in the Practicality scale correlate 
.50 or higher with the Practicality score. 

6. Reliability of the scales, for the sample of 100 insti- 
tutions and using K-R 20, is very high: Practicality, .94, 

Community, .95, Awareness, .96, Propriety, .93, and Scholarship, .95. 

7. The distribution of scores for the 100 institutions shows 
a good spread, with the means being close to the theoretical 
midpoint, and with large sigmas. 
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Institutional Differences and Norms 



1. The diversity of educational environments in higher educa- 
tion across the country is clearly and thoroughly demonstrated by 
the present study. Colleges are tremendously different from one 
another. In one college, for example, all 20 of the items in the 
Scholarship scale were answered in the keyed direction by a con- 
sensus of greater than two to one among the respondents at that 
college; in another college nearly all of these items were answered 
with the same high degree of consensus, but in exactly the opposite 
direction. On all five of the scales one finds that nearly every- 
thing characteristic of some institutions is equally uncharacter- 
istic of others. 

2. There are clear and substantial differences between the 
environments of various types of colleges and universities. In 
some cases the scores of institutions within a type have no over- 
lap with the scores of institutions of another type. On all scales 
the mean differences are also substantial. The mean score of 
Teachers Colleges on the Practicality scale is four times larger 
than the mean score of highly Selective Liberal Arts colleges. 

The mean score of strongly Denominational colleges on the Community 
scale is two and a quarter times larger than the mean score of 
Engineering and Science colleges. The mean score of highly Selec* 
tive Liberal Arts colleges on the Awareness scale is three and a 
half times larger than the mean score of Engineering and Science 
colleges. The mean score of strongly Denominational colleges in 
the Propriety scale is two and two-thirds times larger than the mean 
score of highly Selective universities. And on the Scholarship 
scale, the mean score of highly Selective Liberal Arts colleges is 
two and a half times larger than the mean score of Teachers Colleges. 

3. The grouping of institutions into the eight types des- 
cribed in the present study results in very few deviant cases 
within any type, that is, institutions which do not clearly fit 
within the type. Only two of the 40 groupings (eight types on 
five scales each) had more than one deviant case. Thus, the ty- 
pology used in devising the national reference group of 100 in- 
stitutions was substantially validated or confirmed by the sub- 
sequent empirical data. 

4. Moreover, the range of scores among institutions of a 
given type is substantially smaller than the range of scores across 
all 100 institutions. For all but one of the eight types, the 
typical reduction in range was more than half. For General Liberal 
Arts colleges, the most diverse group, the reduction was one- third. 

5. Each of the eight types of higher institutions has a dis- 
tinct profile. The most similar profiles are between the General 
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Liberal Arts colleges and the strongly Denominational colleges, and 
between the General Universities and the State Colleges. In each 
of these instances, however, there was still one scale on which the 
difference was more than 30 percentile points. 



Validity and Other Interpretive Information 

1. Characteristics of students are, to some extent, con- 
gruent with characteristics of the school they attend. Although 
student characteristics by no means account for the environmental 
differences between colleges, and are almost completely unrelated 
to what is perceived to be true about any given campus, there is 
obviously some selective matching between students and colleges. 

There is a relationship between the scholastic aptitude of the 
entering freshmen and the Scholarship press of the college; between 
the esthetic interests of the entering students and the Awareness 
press of the college; between the religious interests of students 
and the Propriety and Community press of the college; and between 
the masculinity and pragmatic interests of the students and, negatively, 
the Community and Propriety press of the environment. These, Lnd simi- 
lar relationships, are generally expressed by correlations in the 
• 40s to . 60s • 



2. The behavior of students, and various attitudes and values 
expressed by them in college are also, to some extent, congruent 
with the environmental press of their campus. Church attendance 

is related to the Community and Propriety press of the college. 
Planning to enter graduate school is related negatively to the 
Practicality, Community and Propriety press and positively to the 
Scholarship press. Majoring in such fields as social science and 
humanities is related to the Awareness press; majoring in business 
is related to the Practicality press; majoring in Education is 
related to the Practicality and Propriety press; majoring in 
Engineering is negatively related to the Community press. Feeling 
a strong emotional attachment to the college is related to its 
press toward Community and Awareness. Participating in extra-cur- 
ricular activities is related to the Community press. These and 
similar attitudes and behaviors have correlations with relevant 
college press that fall generally in the range of .30s to ,50s, 

3. The variables measured by the Environmental Assessment 
Technique (EAT) which, for the most part, are reflections of the 
proportion of students majoring in various fields, and therefore 
of the curricular emphasis of the college, have correlations which 
fall generally in the .30s and .40s with relevant CUES scores. If 
one takes the collective perception of students as the more direct 
measure of campus atmosphere, then o^e must conclude that the 
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indirect measures derived from the EAT have only amodest relation 
to the directly perceived characteristics of the campus, 

4. Some of the "institutional factors" described by Astin, 
namely Masculinity, Homogeneity of offerings, and Technical Emphasis, 
also have only modest relationships to the campus atmosphere per- 
ceived by students. Size, however, has a high negative relation to 
Community, And Affluence (in student talent and financial resources) 
has high relationship with Scholarship and Practicality, positive 
with the former and negative with the latter. Other institutional 
statistics, which are largely reflections of institutional size, 
such as number of faculty members, number of books in the library, 
dollars of current income, are negatively correlated with Community 
and Propriety, generally in the .408 and .50s. 

5. The overall network of correlations between CUES scores 
and other data can be characterized as broadly supportive of 
associations one might reasonably expect. The conclusion from 
such associations is that campus atmosphere, as measured by CUES, 
is a concept buttressed by a good deal of both concurrent and con- 
struct validity. 
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SUMMARY 



Differences between college students, and between the student 
bodies at different campuses, have long been familiar to psycholo- 
gists and educators; but the systematic study of college environ- 
ments is a much more recent enterprise t College & University 
Environment Scales (CUES) was published by Educational Testing 
Service in the spring of 1963, and its availability has resulted 
in considerable use by researchers and college administrators. 

CUES was an outgrowth of the College Characttris tics Index, de- 
veloped jointly by the present writer and George Stern in 1957. 
CUES consists of half of the items in the 1958 version of the CCI, 
but its structure and rationale are fundamentally different. 

Like the CCI, it consists of statements about conditions, events, 
and practices which might occur in, or be true of, college cam- 
puses; but unlike the CCI, the measures provided by CUES are along 
five dimensions which emerged from factor analytic studies of 
differences between environments, and the rationale is based on 
the concept of collective perception about what is characteristic 
of the campus. The basic dimensions are labeled practicality, 
Community, Awareness, Propriety, and Scholarship. Each of these 
scales consists of 30 items. The score on a scale is the number 
of items that are characteristic of the particular campus, with 
characteristic defined a6 a high level of consensus, two to one 
or greater, among the reporters. The development of this in- 
strument, together with tentative norms for its interpretation, 
was described in a Preliminary Technical Manual, published by 
Educational Testing Service in the fall of 1963. Because the 
whole notion of measuring the characteristics of environments 
is an intriguing one, opening up the possibility for new and more 
rigorous research on the effects of higher education and providing 
new knowledge about the diversity of educational environments 
across the country, the quality of an instrument used for such 
purposes is of particular importance. The present study, Analyses 
of a National Sample of College Environments, was made in recog- 
nition of this importance. Its objectives were to provide a 
broader baseline of data from which to examine and improve the 
psychometric adequacy of the measuring instrument, to obtain a 
wider network of information bearing on the validity of the test 
and its relationships with other measures in current use, and to 
document more fully the range and patterns of diversity and simi- 
larity that are descriptive of American college and university 
environments . 

In the spring of 1965, when the present study began, CUES 
data were avaiable from approximately 100 institutions. Through 
the USOE contract, we issued invitations to 193 colleges and uni- 
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versities to administer CUES to a representative sample of their 
students. These colleges were ones which had previously been in- 
cluded in studies of students' career plans made in 1961 and 
1964 by the National Opinion Research Center. Their inclusion in 
the present study enabled us to relate a good deal of recent in- 
formation about the schools and the students to the characteris- 
tics of the school environment measured by CUES; and through a 
data sharing agreement with NORC, we provided NORC with informa- 
tion for their subsequent use in making further analyses of en- 
vironmental factors influencing students 9 educational and career 
plans. Of the 193 institutions invited to use CUES, 124 did so. 

The total number of student reporters from these 124 schools was 
15,286. By adding these data to the CUES reports already on hand, 
and other reports received during the first part of 1966, we had 
information from 237 colleges and universities. Since the pre- 
liminary CUES manual was developed from a base of only 50 schools, 
the new base of 237 represented a major improvement. 

From this pool of 237 reports we selected 100 insitutions to 
serve as a national reference group for the subsequent psychometric 
studies. Various cluster analysis computer programs, designed to 
identify similarities between institutions in the profiles of 
their five CUES scores, produced information which led us to iden- 
tify eight "types" of environments: (1) highly selective liberal 

arts colleges, (2) highly selective universities — public and pri- 
vate, (3) general liberal arts colleges, (4) general universities-- 
public and private, (5) State colleges and other universities, 

(6) teachers colleges and others with major emphasis in teacher 
education, (7) strongly denominational liberal arts colleges-- 
Catholic and Protestant, and (8) institutions with a predominant 
emphasis in engineering and sciences. To assure maximum diversity 
and representation, we selected ten institutions of each type, 
except general liberal erts colleges and general universities which 
were represented by 20 institutions each. These 100 institutions 
were further selected so that their resulting distribution was 
nationally appropriate with respect to level of program, geographic 
region, and public and private control--with nationally appropriate 
defined as the number of institutions one should have by level, 
region, and form of control in a sample midway between being rep- 
resentative of institutions and being representative of enrollments. 

The psychometric properties of the current edition of CUES 
were found to be generally adequate but capable of improvement. 

All items correlated positively with the score on the scale in 
which they were located, but some items correlated higher with 
other scale scores. No definable factors other than the ones rep- 
resented by the present scales were revealed, thus confirming the 
basic structure of the test, but nearly a third of the items were 
not as factorial ly clear as they ought to be . A scoring system 
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which included all items about which there was a consensus of two 
to one or greater, both in the keyed direction and in the opposite 
direction, was shown to be better than the present system of 
counting only consensus in the keyed direction. As a result of 
these studies it was decided to adopt the new scoring system and 
to try to improve the test, psychometrically , by eliminating the 
least satisfactory items. 

The revised test consists of five 20-item scales. Studies 
of this test, using the modified scoring system, revealed that 
significant improvements were produced. All items correlated .40 
or higher with the score on the scale in which they were located. 
All except two items had their highest correlation with the cor- 
rect scale. The patterns of item and scale intercorrelations in- 
dicated that greater independence between most scales was now the 
case. Factor analyses revealed a much higher clarity in each of 
the five factors. In the revised test 86 per cent of the items 
had their highest factor loadings exactly where they should have 
them, compared with 68 per cent in the unrevised test. The 
Practicality factor was the least satisfactory, accounting for 
seven of the fourteen imperfectly located items, but all items 
in the revised Practicality scale correlated .50 or higher with 
the scale score. The reliabilities of the revised scales, based 
on the distribution of responses across the national reference 
group of 100 institutions, and using Kuder-Richardson Formula 
No. 20, were as follows: Practicality, .94; Community, .95; 

Awareness, .96; Propriety, .93; and Scholarship, .95. 

Based on these shorter and better scales, the scores of the 
100 institutions were plotted and grouped into the eight types 
of institutions previously described. The diversity of educa- 
tional environments across the country is strikingly obvious 0 On 
all five of the scales one finds that nearly everything charac- 
teristic of some institutions is equally uncharacteristic of others. 
Moreover, there are large differences between many of the institu- 
tional types. The highest mean scores of the institutions within 
a given type are from two and one-fourth to four times higher than 
the mean score of institutions within another type. In many cases 
there is no overlap in the scores of institutions of different 
types. In most of the types, the range of scores between the high- 
est and lowest case is less than half the range of scores across 
the total group of 100 schools. An indication of the validity of 
the typology is the fact that there were very few deviant cases, 
that is, cases in which a score was noticeably different from 
other scores within the type. In all, only five per cent of the 
scores could be classified as deviant, twenty-five scores out of 
a total of 500. Of the 40 groupings (eight types on five scales), 

18 had no deviant case, and only two had more than one deviant 
case. Profiles based on the mean scores for institutions within 
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each type showed that each type of school had a distinctly dif- 
ferent pattern of environmental press. Thus, within the great 
diversity of college environments across the country there are 
patterns of similarity, a fact which had definite practical utility 
for aiding parents, counselors, and prospective students in the 
process of college choice. 

Correlations between measures of the college environment from 
CUES and other relevant raeasures--such as the characteristics of 
students, the behavior and attitudes of students, the curricular 
emphasis in the college program, and various institutional fea- 
tures such as size, selectivity, financial resources, etc. --are 
all supportive of associations one might reasonably expect. 

Whether the environment is characterized directly by the collec- 
tive perceptions of the students who live in it, or whether it is 
inferred from student behavior, student characteristics, the em- 
phasis in the college curriculum, or other features such as size, 
selectivity, financial resources, the results are generally con- 
gruent. Different approaches and different questions produce 
somewhat different answers; but no approach produces answers which 
are opposite or contrary to those produced by other methods. Thus, 
all approaches or methods benefit from the network of correla- 
tions reported in the present study. In general, scores on CUES 
correlate with other relevant variables to about the same degree 
as scores on the Scholastic Aptitude Test correlate with college 
grades --namely, from the low .30s to the high .60s. The conclu- 
sion from such associations is that campus atmosphere, as measured 
by CUES, is a concept butressed by substantial evidence of both 
concurrent and construct validity. 

In the revised edition of CUES, the basic scales of 20 items 
each, together with the normative and validity data described 
above, will be supplemented by ten additional items in each scale. 
These were tried out in a few colleges during the present study, 
and their inclusion in a new published version of CUES will lay 
the groundwork for the continuous revision and up-dating of the 
instrument . 

The end results of the present study are a more reliable and 
psychometrically adequate instrument, an improved scoring system, 
a new type of national baseline for studying college er onments, 
a richer documentation of the facts of institutional diversity, 
a new typology of institutions which has practical value for col- 
lege admissions decisions, and an expanded network of correlations 
between various measures of college environments and student char- 
acteristics and behavior which indicate that different methods of 
describing environments produce broadly congruent results, thus 
strengthening the case for the validity of CUES as a measuring 
instrument . 
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APPENDIX A 

UNIVERSITY OF CALIFORNIA, LOS ANGELES 



BERKELEY • DAVIS * IRVINE • L08 ANGELES • RIVERSIDE « SAN DIEGO • SAN FnANCISCO 




DEPARTMENT OF EDUCATION 
LOS ANGELES, CALIFORNIA 90024 



I am writing to invite your participation in a research project being 
conducted under my direction at UCLA in collaboration with the Educational 
Testing Service, Princeton, New Jersey, and the National Opinion Research 
Center, University of Chicago* 

The study involves collecting data from a national sample of colleges 
and universities. These institutions, approximately 200 of them, are 
ones in which graduating seniors in 1961 or in 1964 were previously 
questioned about their career plans by the National Opinion Research 
Center. The data I am now requesting from these same institutions will 
be used* in part, to enrich our understanding of factors in the college 
environment which seem to have had some influence on students 1 career 
choices and educational plans. The data will also be used to document 
more fully the diversity, the similarities , and the uniqueness of college 
environments across the country. 

Over the past three years, an opinion poll type of instrument called 
College & University Environment Scales (CUES) has been used by 100 or so 
colleges. For the present research study, I am asking that this instrument 
be given to a group of students at your campus. If you or someone on 
your campus will agree to do this, copies of the test, together with 
answer sheets and a manual of instructions, will be sent to you. After 
the students have taken the test, you will mail the answer sheets to 
Educational Testing Service where the results will be tabulated and 
reported back to you. The test materials and the subsequent report of 
results will be provided at no cost to you. In addition, there will be 
an honorarium of to the person who assumes responsibility for 

administering the tests at your campus. 
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I hope very much that you, or someone whom you will invite, will 
agree to participate in this research. The enclosure gives more informa- 
tion about the test and its administration. 

There is also enclosed an acceptance order form. If you will fill 
this out and mail it to Educational Testing Service, you will receive, 
promptly, the number of CUES booklets and answer sheets designated for 
your campus. If you cannot accept this invitation now, because no one 
on your campus is able to administer the test before the end of the school 
year, I would appreciate your letting me know. Perhaps, in some cases, 
an arrangement can be made for your participation soon after school 
opens next fall. 



Sincerely, 




C. Robert Pace 
Director, Higher Education 



Research Project 



Enc. 
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Information about CUES and its Administration for The 
National Study of College Environments 



College 6c University Environment Scales (CUES) contains 150 statements 
about college life -- events, conditions, policies, procedures, activities, 
interests, etc. Students mark each statement true or false depending on 
whether, in their experience, they believe it to be generally character- 
istic or not characteristic of their college. The responses are added 
together to. show what percentage of the students regard each statement as 
generally true. Those statements about which a substantial majority agree 
(by a ratio of 2 to 1 or better) are regarded as Characteristic' 1 of the 
college, as the students perceive it. 

Each college will receive a tabulation of its own results. These 
results are also summarized in five overall scores, providing a profile 
of the institutions characteristics along each of the following dimensions: 

1) scholarship -- intellectuality, and academic discipline, 2) awareness -- 
of personal identity, esthetic sensitiviLy, and social issues, 3) community -- 
a friendly, congenial, supportive atmosphere, 4) propriety -- mannerly and 
considerate as compared to rebellious and non-conformist, and 5) practicality 
concern for practical benefits and personal status. 

Although there is no time limit on the test, most students will be 
able to complete it in 20 to 30 minutes. 

STUDENTS TO BE TESTED 



The first requirement here is that they be qualified reporters in 
the sense of having been on the campus long enough to be reasonably well 
acquainted with its features. Full-time students who have been on the 
campus at least three semesters or more are considered to be qualified 
reporters. In other words, any representative group of undergraduate 
students (excluding freshmen, recent transfers, and part-time students) 
may be tested. 



The second requirement is that the students be reasonably representative 
of the student body -- for example, both men and women on coed campuses, 
students from several major divisions or schools on complex university 
campuses* Suggestions for getting together easily a suitable representative 
group of reporters will be sent with the test materials. 




The third requirement concerns the number of students to be tested. 

This is related to the size of your institution. The number of tests and 
answer sheets you will receive is indicated on the enclosed acceptance 
order blank. We hope you will be able to use all or nearly all of these 
tests, and that, in any event, you will succeed in getting at least 2/3 or so 
of them used. The test can be administered to students in a group, or sent 
to students individually, whichever is more convenient for your particular 
campus. Full instructions for administering the test will be sent to 
each participating college. 
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USES OF THE RESULTS 



At many colleges where CUES have been used, the results have provided 
a stimulus to self-study, with faculty members, administrators, and sometimes 
students considering the actual profile of the campus in relation to what 
might be regarded as an ideal environment. In other colleges CUES have 
been used in local research studies, providing a description of the 
environment within which student attainment and adaptation may be viewed 
in new perspectives. The test manual reports tentative norms against which 
the characteristics of your college may be compared. Colleges which partici- 
pate in the present research rtudy may keep the CUES test booklets for what- 
ever further use they wish to make of them. 



SUMMARY OF AGREEMENT 



Your participation in this national study of college environments involves 
the following agreements: 

1. To administer CUES at your campus before the end of the current 
school year. The number of tests you will receive is . You will use 
is many of these as you can; but in any case will agree to get responses 
from not less than students. 

2. To administer these tests to a reasonably representative group of 
students: and to report briefly how the students were selected and the 
conditions under which they were tested. 

3. To send all completed answer sheets to ETS for scoring. 

In return for your cooperation you will be provided with the following: 

1. All necessary materials and instructions. 

2. A full report of the results at your institution. 

3. An honorarium of for your services. 



ORDER AND AGREEMENT FORM 



The National Study of College Environments 



AGREEMENT : 

We agree to administer the College & University Environment Scales 
under the procedures specified, and to return all completed answer sheets 
to the Educational Testing Service for processing. It is understood that 
the undersigned will receive a complete report of the analyses for this 
institution, for whatever uses it may serve. It is further understood that 
data will be employed by the National Opinion Research Center, ETS , and 
the Project director, Dr. Pace, for research purposes only and that no 
published reports will identify the results at any specific institution 
without prior approval. 



(Name and Title) 



(Signature) 



SHIPPING ORDER : 

Please ship, to the person designated below, CUES booklets 

and answer sheets, together with manual acid instructions for 
administering. 



(name) 



(position) 



(institution) 



(address) 

We anticipate return of answer sheets for scoring approximately _ 

(date) 




NOTE: THIS FORM SHOULD BE RETURNED DIRECTLY TO: 

Office of Special Tests (807-5) 
Educational Testing Service 
Princeton, N.J. 
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THE NATIONAL STUDY OF COLLEGE ENVIRONMENTS (CUES-807-5) 

Unit Control Sheet 

NOTE: This sheet must be returned with answer sheets for scoring. All answer 

sheets from a particular institution will be combined to provide one roster of 
institutional scores. Therefore, all answer sheets should be packaged together 
with this form on top. (If it is necessary to break a set into several packages 
for shipment, note this fact below in the appropriate space; but, only one of 
these packages should contain this form.) 

Instructions for the Test Administrator: 

1. Complete all items preceded by an asterisk (*) below. 

2. Mail the answer sheets with this Unit Control Sheet to: 

Receipts Processing (P/j #807-05) 

Educational Testing Service 
Princeton, New Jersey 08540 



* How was the sample of students selected? Under what conditions were the 
tests administered? (e.g. "All students in five sections of a required 
sophomore course were tested in class. "A copy of the test, with covering 
letter, was sent to every nth name from a roster of seniors." Etc.) 



* Date of Test Administration 

* Number of Answer Sheets returned herewith 

* Number of packages used for mailing this group of answer sheets 

* Name and address of person at this institution to whom score report is 

to be sent; 



(Note: Costs of scoring and reporting will be borne by the National Study of 

College Environments. No billing will be made to the institution, except in 
those cases where answer sheets over the number authorized by the project are 
included. In such cases, a purchase order for the excess at the rate of $.60 
per answer sheet should be attached.) 

ETS USE ONLY 



Unit Number 
Batch Number 

Number of answer sheets received (see client count above) 
Number of answer sheets scored and reported 
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CUES Items Included in 



the New 20-Item Scales 



Practicality 


Community 


Awareness 


Propriety 


Scholarship 


2 


i 


4 


61 


16 F 


7 


32 


47 


63 


17 


8 


34 F 


50 


65 F 


21 F 


10 


35 


54 


66 F 


22 


11 


36 


56 


70 


23 


12 


40 


57 


71 


24 


14 


42 


58 


72 F 


27 F 


18 


43 


59 


73 F 


28 F 


77 


44 


60 


75 F 


29 


78 


45 


62 


136 F 


30 


79 


107 


122 F 


137 F 


92 


80 


108 F 


123 


139 F 


95 


81 


110 


124 


141 F 


96 


83 


111 


127 


142 F 


98 


84 


114 


130 F 


A/r F 


99 


85 F 


115 


131 


146 F 


100 


86 


117 F 


132 


147 


101 


87 


119 


133 


148 


104 F 


88 


138 


134 


149 F 


105 


90 


144 


135 


150 


121 




New Items To Be Included --Revised CUES 



Practicality 

Most people are aware of the financial status of students' 
families . 

Student organizations are required to have a faculty adviser. 

There are good facilities for learning vocationally useful 
skills and techniques. 

There is a well-organized and effective job placement office 
for the graduating students . 

Vocational guidance is a main activity of the counseling office. 

Most faculty members really know the regulations and require- 
ments that apply to student programs. 

Many faculty members are involved in services or consulting 
activities for outside groups--business , adult education, etc. 

The vocational value of many courses is emphasized. 

Professors will often increase a student’s grade if they think 
he has worked especially hard and conscientiously. 

Most students want to get a degree because of its economic value. 
Community 

The campus design, architecture, and landscaping suggest a 
friendly atmosphere. 

Counseling and guidance services are really . personal, patient, 
and helpful. 

There are courses or voluntary seminars that deal with problems 
of marriage and the family. 

There are courses which involve students in activities with 
groups or agencies in the local community. 

There are courses or voluntary seminars that deal with problems 
of social adjustment. 

In most classes the atmosphere is very friendly. 

Student groups often meet in faculty members 1 homes. 

Most of the students here are pretty happy. 

Most students seem to have a genuine affection for this school. 

Groups of students from the college often get together for 
parties or visits during holidays. 
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New Items To Be Inc luded--Revised CUES (continued) 



Awareness 

Students are free to cut classes at their own discretion. 

There is a regular place on the campus where students can 
make speeches about controversial issues. 

Many faculty members have worked overseas or frequently traveled 
to other countries. 

There is a lot of variety and innovation in the way many courses 
are taught . 

Many professors permit, and sometimes welcome, class discussion 
of materials that are outside their field of specialization. 

Many student groups invite faculty members to lead special 
discussions • 

Student chorus, orchestra, and theater groups are really 
exce llent . 

Many students are interested in joining the Peace Corps or are 
planning, somehow, to spend time in another part of the world. 

Groups of students sometimes spend all evening listening to 
classical records ^ 

Students like to browse in book stores. 

Propriety 

Nearby churches have an active interest in counseling and youth 
programs . 

The Dean of Students office is mainly concerned with disciplinary 
matters . 

Faculty members are always polite and proper in their relations 
with students. 

Faculty members always wear coats and ties on the campus. 

Most professors think of themselves as no different from other 
adults in the community. 

Proper standards and ideals are emphasized in many courses. 

A major aim of this institution is to produce cultivated men 
and women. 

In literature, drama, and music the main emphasis is on the 
classics • 

Many professors require students to submit an outline before 
writing a terra paper or report. 
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New Items To Be Included--Revised CUES (continued) 



In most exams the emphasis is on knowing the correct answers 
rather than on being able to defend a point of view. 



Scholarship 

New ideas and theories are encouraged and vigorously debated. 

Excellence in scholarship is the dominant feature of this 
Institution. 

Students who don't make passing grade are quickly dropped 
from school. 

Students are allowed to help themselves to books in the 
library stacks. 

There are lots of quiet and comfortable places for students to 
8 tudy . 

The library is one of the outstanding facilities on the campus. 

There are many excellent facilities for research on this campus. 

The main emphasis in most departmental clubs is to promote 
interest and scholarship in the field. 

Even in social groups students are more likely to talk about 
their studies than about other things. 

Most students are pretty dissatisfied if they make less than a 
B grade . 



